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In  accordance  with  the  requirements  of  the  Civil  Service  Reform  Act  of  1978,  it  is  an  honor  to  submit 
this  Merit  Systems  Protection  Board  report  entitled  “Workforce  Quality  and  Federal  Procurement:  An  Assess¬ 
ment.” 


In  order  to  accomplish  the  many  tasks  assigned  to  the  Federal  Government,  agencies  rely  extensively  on 
the  procurement  of  goods  and  services  from  the  private  sector.  This  report  examines  the  quality  of  the  members 
of  the  Federal  procurement  workforce  and  the  work  they  perform. 

Although  contract  specialists  and  their  supervisors  believe  members  of  the  procurement  workforce  are 
well-qualified  to  perform  their  jobs,  clients  are  not  altogether  satisfied  with  the  quality  of  service  they  receive. 
The  implications  of  these  findings  are  discussed  and  recommendations  are  offered  for  improving  the  quality  of 
Federal  contracting  efforts. 

We  believe  that  you  will  find  this  report  useful  as  you  consider  issues  concerning  the  efficient  and 
effective  management  of  the  Federal  civilian  workforce. 


Respectfully, 


Daniel  R.  Levinson 
Chairman 


itonio  C. 

Vice  Chairman 
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Jessica  L.  Parks 
Member 


The  President 

President  of  the  Senate 

Speaker  of  the  House  of  Representatives 


□  □ 


A  Special  Study 


WORKFORCE  QUALITY 
AND  FEDERAL  PROCUREMENT; 

AN  ASSESSMENT 


92-20975 

llllllll 


8  9  057 


U.S.  Merit  Systems 
Protection  Board 


DANIEL  R.  LEVINSON,  Chairman 
ANTONIO  C.  AMADOR,  Vice  Chairman 
JESSICA  L.  PARKS,  Member 


LUCRETIA  F.  MYERS,  Executive  Director 


Office  of  Policy  and  Evaluation 

Director 
Evangeline  W.  Swift 

Deputy  Director 
John  M.  Palguta 

Assistant  Director  for  Special  Studies  and  Legal  Policy 

Bruce  C.  Mayor 

Project  Manager 
John  Crum,  PhD. 


Table  of  Contents 

Executive  Summaiy .  iii 

Introduction .  1 

Background .  1 

Why  Study  the  GS-n02  Procurement  Workforce? .  2 

Purposes  of  This  Study .  3 

Quality  in  Procurement:  Views  from  the  Workforce .  5 

Methodology .  5 

General  Characteristics  of  Federal  Contract  Specialists .  7 

Katings  of  Quality  of  Performance  on  Critical  Tasks .  7 

Ratings  of  the  Abilities  of  Contract  Specialists . 10 

Research  and  Official  PerformaiKe  Appraisal  Ratings . 13 

Factors  Related  to  Contract  Specialist  Workforce  Quality . 16 

Educational  Characteristics  of  Contract  Specialists . 16 

Completion  of  Government-Sponsored  Training  Courses . . . 19 

Awards  Received  by  Members  of  the  GS-1102  Workforce . 20 

Other  Factors  Affecting  the  Quality  of  Work  in  Federal  Procurement . 21 

Changes  in  Workforce  Quality  Over  Time . 23 

Sources  of  Entry  Into  Procurement  Positions  and  Workforce  Quality . 25 

Quality  in  Procurement:  Views  of  Clients . 31 

SampUng  Client  Views . 31 

The  Quality  of  Solicitations . 32 

Client  Views  of  Procurement  Workforce  Quality . 34 

Client  Views  of  the  Federal  Procurement  Process . 39 


A  Report  hy  the  U.S.  Merit  Systems  Protection  Board  -  i 


Confenis 


Possible  IndicataMS  of  Workforce  Quality . 43 

Method  for  Demonstrating  the  Utility  of  Potential  Quality  Indicators . 43 

Relationships  Between  Work  Performance  Assessments  and  Potential  Indicators  of  Quality . 44 

Summary  of  Findings  on  Quality  in  Federal  Procurement . 47 

The  Quality  of  Work  in  Federal  Procurement . 47 

Validation  of  Potential  Quality  Indicators . 49 

Establishment  of  a  Baseline  for  Future  Research . 50 

Recommendations . 51 

Recommendation  1:  Provide  Additional  Training  to  Improve  the  Quality  of  the 

Current  Workforce . 51 

Recommendation  2:  Encourage  and  Reward  Creativity . 52 

Recommendations:  Ensure  that  High  Quality  Selections  Are  Made  for  Entry-Level  Positions . 52 

ReconuneiKlation  4:  Where  Possible,  Streamline  arrd  Simplify  the  Procurement  Process . 53 

Appendix . 55 


i  i 


A  Report  by  the  U.S.  Merit  Systems  Protection  Board 


In  1991,  over31/XX)  Federal  procurement  professionals  toere  responsible  for  purchasing  more  than 
$191  billion  in  goods  and  services  for  the  Federal  Government.  Not  surprisingly,  given  a  massive 
Federal  budget  deficit  and  periodic  allegations  ofxoaste  and  mismanagement  in  the  procurement 
process,  a  great  dieal  of  attention  has  been  focused  on  the  quality  of  the  Federal  workers  responsible  for 
the  vast  number  of  contract  and  procurement  actions  takm  each  year.  How  qualified  are  these  loorkers? 
Can  their  quality  level  be  improved  and,  if  so,  how?  Would  improvements  in  workforce  quality  result 
in  a  more  effective  and  efficient  procurement  process?  These  were  questions  the  U.S.  Merit  Systems 
Protection  Board  sought  to  answer  in  a  comprehensive  study  of  the  loorkforce  quality  and  Federal 
procurement. 

As  discussed  in  this  report,  the  Board  found  that  while  there  is  little  evidence  to  suggest  that  the  quality 
of  the  Federal  procurement  workforce  has  actually  declined,  neither  has  there  been  an  increase  in 
xvorkforce  quality  to  match  the  increasing  demands  that  have  been  placed  on  procurement  professionals. 
In  fact,  according  to  those  most  familiar  zoith  the  procurement  system,  the  workforce  is  struggling  to 
keep  up  with  potentially  counterproductive  growth  in  Federal  procurement  policy  and  procedures 
coupled  with  an  increase  in  the  complexity  ^  the  goods  and  services  that  the  Government  contracts  for. 
Correcting  this  situation  could  involve:  1)  ^orts  to  improve  the  selection  and  training  of  procurement 
professionals;  2)  efforts  to  encourage  and  reward  creativity;  and  3)  efforts  to  simplify  the  procurement 
process. 


Contract  specialists,  negotiators,  officers,  or  admin¬ 
istrators,  procurement  analysts,  cost  analysts,  and 
small  business  specialists — ^individuals  working 
under  these  various  job  titles  make  up  the  GS-1 102 
series  portion  of  the  Federal  procurement 
workforce.  It  is  this  very  important  segment  of  the 
Federal  workforce  that  serves  as  the  focal  point  for 
this  study  by  the  U.S.  Merit  Systems  Protection 
Board  or  the  Board).  Even  relatively 
nnodest  improvements  in  the  effectiveness  of 


procurement  professionals  can  have  a  tremendous 
budgetary  payoB  given  the  tens  of  billions  of 
dollars  involved  in  the  transactions  monitored  or 
controlled  by  this  segment  of  the  Federal 
workforce. 

One  of  the  statutory  responsibilities  of  the  Board  is 
to  provide  the  President  arxi  Congress  with 
periodic  reports  on  the  health  of  the  Federal  Civil 
Service  arKi  other  merit  systems.  A  major  purpose 
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of  the  civil  service  system  is  to  enhance  the  effi¬ 
ciency  and  effectiveness  of  the  Federal  Govern¬ 
ment  by  providing  for  a  well-qualified  and  moti¬ 
vated  workforce.  Assessing  the  quality  of  the 
Federal  workforce,  therefore,  has  been  an  area  of 
ongoing  interest  for  MSFB.  This  particular  study 
was  initiated  to  evaluate  the  quality  of  the  em¬ 
ployees  involved  in  Federal  procurement  activities 
and  the  work  that  they  perform. 

The  information  discussed  in  this  study  was 
obtained  through  four  surveys  distributed  to 
different  groups  in  order  to  obtain  a  variety  of 
perspectives  on  the  quality  of  work  performed  by 
members  of  the  procurement  workforce.  Surveys 
were  sent  to  approximately  9,300  current  procure¬ 
ment  professionals  and  their  immediate  supervi¬ 
sors.  These  surveys  asked  questions  about  how 
well  members  of  Ae  procurement  workforce 
performed  the  various  tasks  involved  in  their  jobs 
and  factors  which  they  believe  affected  perfor¬ 
mance.  Information  concerning  the  qu^ty  of 
service  provided  by  procurement  professionals 
was  obtained  from  two  client  groups — Senior 
Executive  Service  (SES)  members  and  private 
contractors. 


Findings 

□  Both  contract  specialists  and  their  supervi¬ 
sors  were  quite  positive  about  the  capabili¬ 
ties  of  current  members  of  the  procurement 
workforce.  In  fact,  both  supervisors  and 
employees  believe  the  quality  of  the  procure¬ 
ment  workforce  is  adequate,  if  not  superior. 
Almost  two-thirds  of  the  employees  said 
that  they  are  capable  of  performing  the  tasks 
required  by  their  jobs  in  an  outstanding 
manner.  This  assessment  of  workforce 
capabilities  was  supported  by  the  fact  that  77 
percent  of  the  employees  reported  receiving 
above  sadslactory  annual  performance 
appraisal  ratings.  Moreover,  almost  two- 
thiids  said  that  they  received  some  type  of 
award  during  1991. 


□  While  not  quite  as  positive  as  their  subordi¬ 
nates,  supervisors  reported  But  die  contract 
specialists  who  work  for  them  have  the 
basic  skills,  knowledges,  and  abilities 
needed  for  their  jobs.  When  rating  their 
subordinates  on  tasks  that  were  identified  as 
critical  to  the  work  of  contract  specialists 
using  a  five-point  scale  (with  5  being  excep¬ 
tional),  employees  received  an  average 
rating  of  3.7.  The  only  ability  in  which 
supervisors  were  critical  of  their  subordi¬ 
nates  was  in  their  lack  of  creativity. 

□  Although  employees  and  their  supervisors 
were  quite  positive  about  the  capabilities  of 
contract  specialists,  both  groups  indicated 
that  procurement  professionals  need 
substantial  amounts  of  additional  training. 
Supervisors,  in  particular,  said  that  a  major¬ 
ity  of  their  subordinates  could  benefit  from 
additional  training  in  the  areas  of  analytical 
ability,  writing  ability,  being  innovative,  and 
the  ability  to  conduct  negotiations. 

□  Responses  from  the  two  client  groups  also 
indicated  that  members  of  the  procurement 
workforce  were  capable  in  a  number  of 
ways.  Both  SES  members  and  private 
contractors  said  that  contract  specialists  were 
knowledgeable,  helpful,  well  trained,  and 
generally  awarded  contracts  fairly. 

□  Despite  die  high  rating  given  to  the  capa¬ 
bilities  of  contract  specialists  by  their 
clients,  it  was  also  clear  that  the  service 
provided  to  clients  was  not  always  satisfac¬ 
tory.  Respondents  from  both  groups  said 
that  the  procurement  actions  were  fre¬ 
quently  not  completed  in  a  timely  manner, 
Uiat  contract  specialists  did  not  demonstrate 
sufficient  creativity  in  their  work,  and  that 
the  procurement  process  did  not  always 
serve  the  best  interests  of  the  Government. 
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□  Re^onses  from  all  four  groups  indicated 
that  many  of  the  problems  that  exist  in 
Federal  procurement  are  the  result  of  the 
increasing  cmnplexity  of  the  procurement 
process.  In  the  view  of  respondents  from  all 
groups,  the  process  has  become  so 
complicated  that  it  is  sometimes  beyond  the 
capability  of  the  average  contract  specialist  to 
meet  the  needs  of  his  or  her  organization  in  a 
timely  manner  while  at  the  same  time 
ensuring  that  no  regulations  are  broken. 
Frequently,  only  the  exceptionally  talented 
contract  specialist  is  able  to  be  fully  respon¬ 
sive  to  organizational  needs  while  still 
adhering  to  regulatory  requirements. 

Recommendations 

1.  Provide  Additional  Training  to  Improve  the 
Quality  of  the  Current  Workforce.  Contract 
specialists  need  to  be  better  prepared  to  make 
the  best  possible  business  decisions  and 
provide  customer  oriented  support  for  their 
organizational  clients.  Based  upon  the 
information  provided  by  procurement 
supervisors,  training  for  contract  specialists 
should  be  directed  towards  improving  the 
capability  of  the  workforce  to  conduct  nego¬ 
tiations,  aiudyze  requirements,  write  clearly, 
and  develop  innovative  solutions  to  meet 
organizational  needs. 

2.  Encourage  and  Reward  Creativity.  Al¬ 
though  supervisors  of  contract  s(>edalists 
criticize  their  subordinates  for  a  lack  of 
creativity,  it  is  supervisors  who  must  bear  at 
least  some  of  the  responsibility  for  this  state 
of  affairs.  If  contract  specialists  are  to  be 
more  creative,  supervisors  need  to  foster  an 
environment  where  employees  are  not  afraid 
to  be  innovative.  Through  their  leadership, 
supervisors  need  to  show  employees  how 


they  can  be  more  responsive  to  their 
customers  in  a  cost-effective  manner  without 
breaking  the  rules. 

3.  Ensure  dial  High-Qujdity  Selections  Are 
Made  for  Entry-Level  Positions.  Over  time, 
an  improvement  in  the  quality  of  people 
becoming  contract  sped^ts  can  have  a 
major  impact  on  the  quality  of  Federal 
procurements.  In  the  recent  past,  supervi¬ 
sors  have  not  always  looked  to  all  possible 
recruitment  sources  when  filling  vacancies. 

In  this  regard,  greater  use  should  be  made  of 
candidates  referred  for  consideration  using 
OPM's  new  Administrative  Careers  with 
America  procedures.  When  considering 
current  Federal  employees  for  placement  into 
entry-level  procurement  (GS-li02)  positions, 
managers  should  use  a  wide  area  of 
coirsideration  to  gather  a  pool  of  high-quality 
applicants  from  a  broad  range  of  occupations 
and  Federal  organizations. 

4.  Where  Possible,  Streamline  and  Simplify 
foe  Procurement  Process.  The  architects  of 
the  procurement  process  must  constantly 
strive  to  provide  regulatory  and  procedural 
safeguards  against  abuse  while  still  allowing 
room  for  the  exercise  of  reasonable  judge¬ 
ment  on  the  part  of  contract  specialists. 
Contract  specialists,  their  supervisors,  and 
their  cliente  all  suggest  that  a  reasonable 
balance  in  this  regard  has  not  been  achieved 
in  that  the  system  tilts  too  heavily  towards 
overly  elaborate  regulatory  requirements  and 
proc^ures.  Too  often,  it  was  reported, 
procurement  or  contract  decisions  could  not 
be  made  in  the  best  interests  of  the  Govern¬ 
ment  and  the  taxpayer  because  of  the  lack  of 
flexibility.  For  this  reason,  some  simplifica¬ 
tion  of  the  procurement  process  could 
actually  improve  its  eftidency  and  cost- 
effectiveness. 
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Background 

For  a  number  of  years  concern  has  been  growing 
about  the  quality  of  the  Federal  workforce.  This 
issue  has  important  implications  for  the  entire 
country.  In  this  era  of  budget  constraints,  it  is 
particularly  important  that  the  quality  of  the 
Federal  workforce  be  sufficient  to  permit  the 
Government  to  provide  the  services  required  by 
the  American  public  as  efficiently  as  possible. 

In  recent  years,  members  of  the  public  administra¬ 
tion  conununity  have  raised  concerns  about  a 
possible  decline  in  the  quality  of  the  Federal 
workforce  and  the  effect  it  may  have  on  Govern¬ 
ment  operations.  Many  believe  that  the  refusal  to 
grant  pay  increases  ne^ed  to  maintain 
comparability  with  the  private  sector  in  the  past 
and  the  deteriorating  image  of  the  Federal 
workforce  have  worked  together  to  reduce  the 
number  of  highly  qualified  applicants  seeking 
Federal  employment.  As  noted  in  several  reports 
by  the  U.S.  Merit  Systems  Protection  Board 
O^PB),  there  is  also  a  perception  among  many 
Federal  managers  that  there  has  been  a  marked 
decline  in  the  quality  of  new  hires.'  To  the  extent 
that  this  has  occurr^,  it  could  have  detrimental 
effects  on  productivity  for  many  years.  In  fact,  the 


US.  General  Accounting  Office  (GAO)  has 
concluded  that  the  Federal  Government's  inability 
to  consistently  assure  the  quality  of  its  workforce 
contributes  to  the  deficiencies  experienced  in  some 
Government  programs  and  services.^ 

Although  concern  about  a  possible  decline  in 
quality  has  been  widespread,  there  have  been 
little  or  no  concrete  data  to  confirm  or  contradict 
this  belief.  Persons  who  have  advocated  changes 
in  personi^el  policies  to  improve  the 
Government's  ability  to  attract  and  retain  high- 
quality  employees  have  had  only  anecdotal 
reports  to  support  their  position.  The  lack  of  hard 
data  concerning  the  quality  issue  prompted  the 
House  Committee  on  Post  Office  and  Civil  Service 
to  ask  GAO  to  determine  the  feasibility  of  assess¬ 
ing  the  current  quality  of  the  Federal  workforce 
and  any  changes  that  may  occur  over  time.  In 
response  to  this  request,  GAO  issued  a  report 
which  recommended  a  methodology  for  collecting 
quality-related  information  in  selected  Federal 
occupations.* 


'  u  s.  Merit  Systems  Protection  Board  reports  addressing  the  issue  of  a  jxissible  decline  the  quality  of  the  Federal  workforce  indude: 
"Federal  Personnel  Polides  and  Practioes — Perspectives  From  the  Workplace,"  December  1987;  and  "Working  for  America:  A  Federal 
Employee  Survey,"  June  1990. 

'  U.S.  General  Accounting  Office,  “The  Public  Service:  Issues  Affecting  Its  Quality,  Effectiveness,  Integrity  and  Stewardship,"  June  1989. 
’  U.S.  Genera]  Accounting  Office,  "Federal  Workforce:  A  Framework  for  Studying  Its  Quality  Over  Tune,"  August  1988. 
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Since  there  are  no  known  historic  staiKlards 
against  which  to  compare  the  quality  of  today's 
Federal  workforce,  it  may  not  possible  to 
determine  whether  quality  has  declined.  How¬ 
ever,  it  is  feasible  to  assess  the  quality  of  perfor¬ 
mance  by  members  of  the  current  workforce. 

Since  MSFB  believes  that  information  concerning 
Federal  workforce  quality  is  critically  important  to 
Federal  policymakers,  both  to  determine  whether 
interventions  are  needed  and  to  serve  as  a  bench¬ 
mark  for  future  research,  the  Board  undertook  this 
study  of  the  quality  of  the  Federal  procurement 
workforce  and  the  work  th»'  it  performs.^ 

Why  Study  the  GS-1102  Piocurement 
Workforce? 

There  may  be  no  area  where  there  has  been 
greater  concern  about  the  quality  of  Federal 
workers  and  the  work  they  perform  than  in  the 
procurement  of  goods  and  services  from  the 
private  sector.  During  the  1970's  and  early  1980's 
there  were  several  highly  publicized  incidents 
which  involved  questionable  Federal  spending. 
Employees  responsible  for  Government  procure¬ 
ments  were  severely  criticized  for  spending  too 
much  money  to  purchase  a  variety  of  products 
ranging  from  coffee  pots  to  major  weapon  sys¬ 
tems. 

As  a  result,  the  Government  instituted  a  number 
of  changes  in  the  procurement  process  which  were 
intended  to  reduce  the  probabiUty  of  abusive 
sponding.  These  changes  included  increasing  the 
number  of  poople  working  as  contract  specialists.® 


The  intent  was  to  reduce  the  pressure  and  respon¬ 
sibility  for  procurement  actions  that  would  be 
placed  on  any  one  person.  The  net  effect  was  a  61- 
percent  increase  in  the  number  of  people  em¬ 
ployed  in  full-time  permanent  GS-1102  procure- 
nent  positions  between  1980  and  1991  (from 
19,409  to  31,287). 

In  addition  to  increasing  the  number  of  people 
employed  in  the  GS-1102  series,  the  Government 
attempted  to  reduce  the  likelihood  of  abuse  in  the 
procurement  process  by  issuing  many  new 
regulations.  In  fact,  according  to  the  Office  of 
Federal  Procurement  Policy  (OFPP)  of  the  Office 
of  Management  and  Budget,  the  Federal  Acquisi¬ 
tion  Regulations  grew  from  1120  pages  in  1984  to 
1548  p>ages  in  1990.  Moreover,  in  most  cases, 
agencies  have  also  issued  volumes  of  their  own 
internal  rules  interpreting  these  regulations. 

Although  these  actions  may  be  effective  in  reduc¬ 
ing  the  number  of  abuses,  they  may  also  lead  to 
other  problems.  In  1982,  OFPP  spjeculated  that 
work  in  the  procurement  field  would  become 
increasingly  complex  as  a  result  of  so  many  new 
regulations.  Given  this  increase  in  complexity,  it 
was  OFPFs  view  that  a  more  professional  pro¬ 
curement  workforce  would  be  needed  to  carry  out 
agency  missions.®  For  this  reason,  OFPP  pro¬ 
posed  the  development  of  a  uniform  procurement 
system  and  efforts  intended  to  improve  the 
quality  of  Federal  contract  specialists. 

Despite  OFPP  efforts  at  improvement.  Federal 
procurement  continued  to  be  the  subject  of  much 
criticism  and  scrutiny  during  the  198()'s.  In  1986, 
the  President's  Blue  Ribbon  Commission  on 


*  Other  shidies  issued  by  the  U.S.  Merit  Systems  Protection  Board  concerning  Federal  workforce  quality  include:  ‘Who  is  Leaving  the 
FMeral  Government?,"  August  1989;  "Why  Are  Employees  Leaving  the  Federal  Government?,"  May  1990;  and  "Federal  First-Line  Supervi¬ 
sors:  How  Good  Are  They?,"  March  1992. 

’  For  purposes  of  this  study  we  will  refer  to  all  persons  responsible  for  Federal  procurements  who  work  in  the  GS-1102  occupational 
series  by  the  generic  term  contract  specialist  This  indudes  people  employed  under  the  titles  of  contract  spedalist  contract  negotiator, 
contract  officer,  contract  administrator,  procurement  analyst  and  oBict  similar  positions  dassified  in  the  GS-1 102  series. 

‘  U.S.  Office  of  Maiuigement  and  Budget,  Office  of  Federal  Procurement  Policy,  "Proposal  for  a  Uniform  Federal  Procurement  Systenv" 
February  1982,  p.  37. 
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Defense  Management  (also  known  as  the  Packard 
Conunission)  reviewed  the  Defense  acquisition 
process  and  concluded  that  it  was  cumbersome 
and  inefficient.  They  found  that  acquisition 
personnel  were  burdened  by  too  many  laws, 
regulations,  and  layers  of  review.  The 
Commission  recommended  that  Defense  acquisi¬ 
tion  policy  and  oversight  be  consolidated  and  that 
duplicative  functions  and  excessive  regulations  be 
eliiiunated.  According  to  the  report; 

All  of  our  analysis  leads  unequivocally 
to  the  conclusion  that  the  defense 
acquisition  system  has  basic  problems 
that  must  be  corrected.  These  problems 
cure  deeply  entreirched  arvd  have  devel¬ 
oped  over  several  decades  from  an 
increasingly  bureaucratic  and  overregu- 
lated  process.^ 

Problems  in  the  area  of  procurement  were  not 
limited  to  the  Department  of  Defense  agencies.  In 
1989  GAO  issued  a  study  concenring  the  state  of 
Federal  procurement  across  Government  agencies 
which  concluded: 

The  contracting  defideiKies  that  we 
identified  generally  resulted  from 
people  failing  to  coordinate  or  to  prop¬ 
erly  carry  out  their  responsibilities, 
rather  than  from  a  need  for  additional 
rules  and  regulations  governing  what 
should  be  done  when  writing  or  admin¬ 
istering  contracts.® 


According  to  GAO,  "While  additional  rules  and 
regulations  are  not  required,  we  further  believe 
that  the  deficiencies  identified  will  continue  to 
occur  unless  specific  action  is  taken  to  strengthen 
civilian  agency  contracting  practices."® 

In  addition  to  being  concerned  about  potential 
problems  in  the  Federal  procurement  process,  the 
Board  chose  to  look  at  the  quality  of  Federal 
procurement  because  of  the  tremendous  impact 
contract  specialists  have  on  Government  opera¬ 
tions.  To  illustrate  the  imjwrtance  of  their  work, 
during  1990  alone,  contract  specialists  made 
purchases  costing  the  Government  over  $191 
billion  dollars.’®  This  was  an  increase  of  almost 
$18  billion  dollars  (or  10  percent)  since  1980. 
Unquestionably,  employees  who  play  pivotal 
roles  in  the  expeixiiture  of  such  large  sums  of 
money  can  dramatically  affect  the  quality  and  cost 
effectiveness  of  services  provided  to  the  public  by 
the  Federal  Government. 


Purposes  of  This  Study 

This  study  was  designed  in  an  attempt  to  deter¬ 
mine  the  quality  of  both  the  Government's 
contract  spedafet  employees  and  their  work. 
Since  it  is  difficult  to  develop  an  adequate  single 
definition  of  what  is  meant  by  quality  in  the  area 
of  Federal  procurement,  this  study  tried  to  assess 
quality  from  four  different  perspectives.  Two  of 
these  perspectives  were  provided  by  people 
currently  working  in  Federal  procurement — 
current  contract  specialist  incumbents  and  their 


'  President's  Blue  Ribbon  Commission  on  Defense  Management.  'A  Formula  for  Action:  A  Report  to  the  President  on  I>efense  Acquisi¬ 
tion,"  September  1986,  p.  5. 

•  U.S.  General  Accounting  Office,  "Qvilian  Agency  Procurement:  Improvements  Needed  in  Contracting  and  Contract  Administration," 
September  1989,  p.  33. 

’  Ibid.,  p.  34. 

”  Estimates  of  changes  in  the  number  of  pages  of  the  FAR  between  1984  and  1990  as  well  as  changes  in  the  number  of  people  employed 
in  the  GS-1 102  series  and  monies  spent  were  [provided  by  the  Office  of  Federal  Procurement  Policy  of  the  Office  of  Management  and  Budget. 


A  Report  by  the  U.S.  Merit  Systems  Protection  Board 


3 


Introduction 


supervisors.  The  other  two  perspectives  were 
fix)m  clients  for  the  services  provided  by  contract 
specialists — ^members  of  the  Senior  Executive 
Service  aird  private  sector  vendors  who  provide 
goods  or  services  to  the  Government  ui^er 
contracts  admiivistered  by  contract  specialists.  By 
integrating  the  perspectives  of  employees,  their 
supervisors,  senior  Govenunent  maiutgers,  and 
private  contractors,  this  study  presents  a  multidi¬ 
mensional  picture  of  the  extent  to  which  a  major 
segment  of  the  Federal  workforce  is  accomplish¬ 
ing  its  assigned  tasks. 

Another  of  our  objectives  in  conducting  this  study 
was  to  develop  a  baseline  which  could  be  used  to 
evaluate  the  effects  of  various  factors  on  workforce 
quality  over  time.  Rather  than  having  to  rely  on 
anecdotal  information  concerning  changes  in 
quality,  it  is  our  hope  that  future  researchers  will 


be  able  to  use  these  baseline  data  to  determine 
the  actual  effect  on  contract  specialist  workforce 
quality  of  things  such  as  pay  reform,  recruiting 
initiatives,  and  training  efforts. 

In  addition,  we  used  information  collected  in 
this  study  to  validate  a  variety  of  presumed 
indirect  indicators  of  quality.  We  asked  employ¬ 
ees  and  their  supervisors  p^dpating  in  this 
survey  questions  about  each  employee's  educa¬ 
tion  levd,  major  Held  of  study,  grade  point 
average  in  college,  and  awar^  given.  Re¬ 
sponses  to  these  items  were  statistically 
compared  with  assessments  of  the  qu^ty  of 
work  performed  by  the  mdividual  (as  reported 
in  both  self  rating  and  ratings  provided  by  the 
individual's  supervisor)  to  determine  which  if 
any  of  these  potential  indicators  were  actually 
rented  to  performance. 
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Methodology 

If  we  want  to  understand  the  factors  that  affect  the 
quality  of  the  goods  and  services  obtained 
through  the  Federal  procurement  process,  one  of 
the  best  places  to  start  is  with  the  people  who 
probably  know  the  most  about  the  subject:  the 
Federal  employees  working  in  the  GS-il02  series 
and  their  supervisors.  People  who  actually  work 
as  contract  specialists,  as  well  as  those  who  super¬ 
vise  them,  may  be  in  the  best  position  to  judge 
whether  members  of  the  workforce  have  the  skills, 
knowledges,  and  abilities  that  are  required  by 
their  jobs.  They  are  also  the  best  available  sources 
for  information  concerning  qualifications,  working 
conditions,  and  other  factors  which  may  affect 
how  they  perform  their  jobs. 

In  order  to  obtain  information  concerning  these 
issues,  we  developed  separate  surveys  for  distri¬ 
bution  to  a  sample  of  employees  in  the  GS-1 102 
series  and  their  supervisors.  Employees  were 
randomly  selected  from  the  Central  Personnel 
Data  FUe,  maintained  by  the  U.S.  Office  of  Person¬ 
nel  Management  (OPM),  to  be  representative  of  all 
grade  levels  and  major  agencies  in  the  Federal 
Government.  Survey  questionnaires  for  both 
employees  and  supervisors  were  developed  with 


the  help  of  subject-matter  experts  in  the  area  of 
Federal  procurement,  particularly  the  Federal 
Acquisition  Institute." 

Employees  selected  for  the  survey  were  asked  to 
tell  us  how  well  they  performed  the  aspects  of 
their  jobs  that  were  identified  as  critical  to  suc¬ 
cessful  performance  through  traditional  job 
analysis  techniques.  They  were  also  asked  to  tell 
us  about  their  bockgrovmds  and  the  conditions 
under  which  they  worked.  Copies  of  this  survey 
were  distributed  by  mail  in  March  1991  to  9300 
of  the  approximately  31,000  persons  employed  in 
the  GS-1 1 02  series.  Altogether,  completed 
surveys  were  returned  from  5307  employees,  for 
a  return  rate  of  62  percent. 

In  order  to  get  a  second  perspective  on  each 
employee's  performaiKe,  we  distributed  to  each 
employee's  supervisor  a  survey  very  similar  to 
the  one  sent  to  contract  specialists.  The  question¬ 
naire  for  supervisors  differed  from  the  one  sent  to 
employees  primarily  in  that  it  asked  supervisors 
to  provide  a  confidential  assessment  of  their 
subordiirates'  performance,  in  terms  of  both 
individual  tasl^  and  what  they  added  to  the 
accomplishment  of  organizational  objectives. 


"  Although  normally  MSPB  includes  copies  of  surveys  used  in  an  appendix  to  its  reports,  in  this  case  we  have  chosen  not  to  do  so 
because  of  the  length  of  the  surveys.  Both  the  employee  and  si^xrvisory  surveys  were  each  16  pages  long,  while  die  survey  for  SES 
members  was  8  pages  and  the  survey  for  private  contractors  4  pages.  Anyone  desiring  copies  the  surveys  may  obtain  them  by  writing  to 
the  Office  of  Policy  and  Evaluation,  U.S.  Merit  System  Protection  Board,  1120  Vermont  Avenue,  NW,  Waslungton,  DC,  20419. 
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Since  a  relatively  high  percentage  of  the  total 
GS-1102  workforce  was  includ^  as  part  of  our 
sample,  it  was  not  uncommon  for  a  given  supervi¬ 
sor  to  be  required  to  complete  a  survey  for  more 
than  one  subordinate.  This  placed  a  very  large 
burden  on  some  supervisors.  Despite  this  situa¬ 
tion,  we  received  completed  survey  forms  from 
5,646  of  the  supervisors  of  the  9,300  employees 
selected  for  participation  in  this  study.  This 
represents  a  response  rate  of  61  percent. 


To  a  great  extent,  the  high  response  rate  for  both 
surveys  was  the  result  of  the  emphasis  aiKl 
support  provided  by  the  Office  of  Federal  Pro¬ 
curement  Policy,  its  task  force  for  the 
professionalization  of  the  procurement  workforce, 
and  the  members  of  the  Interagency  Procurement 
Career  Management  Conunittee.  l^PB  is  grate¬ 
ful  for  this  support. 


FIGURE  1. 


DISTRIBUTION  OF  JOB  TITLES  AMONG 
GS-1102  EMPLOYEES 
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General  Characteristics  of  Federal 
Contract  specialists 

According  to  their  responses,  people  working  in 
the  GS-1102  series  most  frequently  describe 
themselves  as  contract  specialists  (49  percent). 
Hgure  1  shows  the  distribution  of  aU  job  titles  for 
respondents.  Among  our  respoiKlents,  6  percent 
were  trainees  (i.e.,  at  grades  5-7),  67  percent  were 
foimd  at  the  GS-9  to  GS-H  levels,  and  27  percent 
were  at  senior  levels  (i.e.,  GS-13  and  above).  The 
mean  and  median  grade  was  GS-IZ  Most  were 
covered  by  the  General  Schedule  pay  system  (81 
percent),  with  18  percent  being  covered  by  the 
PerformaiKe  Management  and  Recognition 
System.  An  additional  0.4  percent  were  members 
of  the  Senior  Executive  Service. 

All  employees  were  asked  in  our  questionnaire 
whether  they  performed  99  difierent  tasks  that 
had  been  identified  as  important  to  the  procure¬ 
ment  function  through  job  analyses  conducted  by 
the  Federal  Acquisition  Institute.  The  results 
showed  that  even  among  employees  with  the 
same  job  title  there  was  a  great  deal  of  diversity  in 
the  tasks  each  employee  was  required  to  per¬ 
form.*^  However,  most  employees  said  that  they 
were  responsible  for  performing  the  majority  of 
the  99  tasks  included  in  the  siuvey. 

Ratings  of  Quality  of  Peifoimance  on 
Critical  Tasks 

Employees  were  also  asked  to  rate  their  own 
performance  using  a  five-[>oint  scale  for  each  of 
the  99  tasks  that  they  personally  performed.  Since 


analysis  of  the  ratings  showed  that  there  was  a 
great  deal  of  variation  in  the  tasks  performed  by 
di^erent  employees,  we  felt  that  rather  than 
looking  at  employee  ratings  on  all  tasks,  it  was 
more  useful  to  look  at  employee  ratings  on  a 
subset  of  tasks  that  were  important  to  most  jobs. 

In  order  to  decide  which  tasks  were  most  impor¬ 
tant,  we  again  asked  for  the  assistaiKe  of  subject- 
matter  experts  at  the  Federal  Acquisition  Institute. 
These  experts  identified  20  tasks  which  they 
believed  were  critical  for  almost  all  contract 
specialists  to  perform  well  Review  of  these  tasks 
showed  that  they  were  performed  by  most  of  the 
people  working  in  this  area.  In  fact,  each  task  was 
performed  by  the  vast  majority  of  the  contract 
specialists  who  were  in  nonsupervisory  positions. 

Employees'  ratings  of  their  performance  on  each 
of  these  20  tasks  are  presented  in  table  1.  A 
response  of  "1"  meant  that  they  believed  they 
were  unable  to  perform  the  task  and  a  "5"  meant 
that  they  performed  this  task  exceptionally  well. 

A  "3"  meant  that  they  performed  this  task  at  an 
acceptable  or  average  level  Table  1  also  shows  the 
average  ratings  provided  by  supervisors  for  their 
subordinates.  In  order  to  be  sure  that  we  were 
looking  only  at  ratings  for  those  employees  who 
have  advanced  beyond  trainee  levels,  only  the 
ratings  for  employees  at  the  GS-9  level  or  above 
were  used  in  computing  the  results  summarized 
in  table  1.  AdditionaUy,  in  the  case  of  supervisory 
ratings,  results  were  based  only  on  ratings  for 
employees  who  have  worked  at  least  6  months  for 
the  supervisor  providing  the  rating.  The  results 
shown  in  tables  2  through  4  are  also  based  solely 
on  ratings  from  employees  who  are  at  grades  G&9 
or  above  and,  in  the  case  of  supervisory  ratings, 
include  only  those  employees  who  have  worked 
for  the  supervisor  providing  the  rating  at  least  6 
months. 


”  An  analysis  of  tasks  perfonned  by  |ob  title  showed  dut  the  survey  did  itot  oomprdwnsively  cover  the  tasks  performed  by  three  groups 
of  employees:  procurement  analysts,  cost  analysts,  and  small  business  ^Kcialisls.  This  actually  occurred  by  design.  We  expected  dut  since 
these  jobs  were  quite  different  in  terms  of  the  tasks  performed,  indusion  of  all  the  tasks  needed  to  cover  dtw  jobs  would  have  nude  the 
questionnaire  far  too  long.  For  this  reason,  analyses  using  ratings  of  performance  cn  job-related  tasks  do  not  include  the  18  percent  of  the 
GS- 1 1 02  workforce  who  work  under  these  duee  job  titles.  Empfoyees  working  in  these  positions  were,  however,  induded  in  aiulyses  based 
vpan  seU-rating?  of  abilities  and  overall  supervisory  assessittaits  of  performance. 
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Table  1 

Average  Self  and  Supervisory  Ratings  of  Performance  on  Critical  Tasks  by  GS-llOZ  Employees 

(Ratings  Provided  for  Employees  at  Grades  C^9  arKi  Above) 

Task 

Ave.  Self 

Ave.  Supervisory 

Rating 

Rating 

Corviuct  market  research 

3.91 

3.70 

Review  statements  of  work 

3.88 

3.77 

(determine  competition  requirements 

4.02 

3.89 

Identify  (mce-related  factors 

3.63 

3.59 

Review  business  management  factors 

3.73 

3.63 

Identify  contract  type 

3.93 

3.78 

Prepare  requests  for  proposals 

4.14 

3.92 

Determine  low  bids 

4.02 

3.89 

Review  technical  evaluatiorrs 

3.91 

3.75 

Evaluate  offas 

3.95 

3.76 

Conduct  cost  analysis 

3.91 

3.72 

Determine  competitive  range 

3.91 

3.74 

Develop  negotiation  strategy 

3.87 

3.68 

Conduct  negotiations 

3.90 

3.75 

IDetermine  starxlards  of  responsibility 

3.98 

3.84 

Respond  to  protests 

3.63 

3.57 

Morutor  compliance 

3.81 

3.71 

Identify  contractual  ranedies 

3.67 

3.56 

Determine  contract  modifications 

4.05 

3.84 

Research  claims 

3.60 

3.57 

Average  for  20  tasks 

3.87 

3.73 

Note;  Rating  scale  is  explained  in  the  text  preceding  this  table. 

Comparisons  of  the  performance  ratings  provided  employees)  thought  that  they  performed  these 
by  both  employees  and  their  supervisors  show  tasks  in  an  above  average  manner.  ^p>ervisor5 

that  both  groups  were  quite  positive  about  the  also  rated  their  employees  positively  but  slightly 
quality  of  the  work  performed  by  members  of  the  Iowct,  with  an  average  rating  of  3.73  (reflecting 

contract  specialist  workforce  on  these  20  critical  that,  on  average,  58  percent  of  the  supervisors 

tasks.  In  £act,  the  overall  mean  rating  of  3.87  reported  that  their  subordiiuites  performed  these 

irxlicates  that  the  overwhekning  majority  of  tasks  in  an  above  average  manner), 

employees  (on  average,  65  percent  of  the 
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It  is  worth  noting  that  there  was  a  tendenqr  for  ratings  of  the  different  tasks  probably  reflect 

both  employees  and  supervisors  to  use  similar  actual  differences  in  performance.  11^  tasks 

patterns  in  rating  each  of  the  20  tasks.  That  is,  with  the  highest  ratings  from  both  sets  of  raters 
although  employees  rated  themselves  higher  than  are  probably  those  that  employees  perform  the 

their  supervisors  did,  they  tended  to  rate  them-  best,  while  those  with  the  lowest  ratings  are  ones 
selves  highest  and  lowest  on  the  same  tasks  as  did  where  employees  most  need  improvement, 

their  supervisors.  This  indicates  that  the  relative 


lkble2 

Percent  of  the  GS-1102  Workforce  Seen  by  Employees  and  Supervisors  as  Needing  Additional 

Training  on  Critical  Tasks 

(Ratings  Provided  for  Employees  at  Grades  GS-9  and  Above) 

Task 

Percent  Needing  Training 
Employee  Rating  Superv 

isor  Rating 

Conduct  market  research 

34 

36 

Review  statements  of  work 

38 

36 

Determine  competition  requirements 

27 

24 

Identify  price-r^ted  factors 

41 

38 

Review  business  management  factors 

42 

41 

Identify  contract  type 

31 

29 

Prepare  requests  for  proposals 

26 

24 

Determine  low  bids 

24 

20 

Review  technical  evaluations 

32 

35 

Evaluate  offers 

33 

35 

Conduct  cost  analysis 

36 

38 

Determine  competitive  range 

29 

31 

Develop  negotiation  strategy 

36 

38 

Conduct  negotiations 

35 

37 

Determine  standards  of  responsibility 

24 

23 

Respond  to  protests 

40 

38 

Monitor  compliance 

30 

30 

Identify  contractual  remedies 

38 

40 

Determine  contract  modifications 

25 

25 

Research  claims 

43 

43 

Average  for  20  tasks 

33 

33 
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To  the  extent  that  self  and  supervisory  ratings  of 
perfbimaiKe  on  these  20  crit^  tasks  are  indica¬ 
tive  of  quality,  it  would  appear  that  the  quality  of 
work  performed  by  members  of  the  G&-il02 
workforce  is  quite  high.  Even  so,  as  shown  in 
table  2,  apparently  a  relatively  large  percentage  of 
both  employees  and  supervisors  believed  that 
there  is  substantial  room  for  improvement  as 
indicated  by  the  percentage  of  employees  and 
supervisors  who  said  that  at  least  a  moderate 
amount  of  training  is  required  in  order  to  perform 
each  task  better. 

If  a  comparison  is  made  between  employees'  self 
ratings  of  performance  shown  in  table  1  and  their 
expressed  need  for  additioiral  training  presented 
in  table  2,  there  is  an  apparent  contradktion. 
Although  the  vast  majority  of  the  employees  (on 
average,  96  percent)  said  that  they  were  perform¬ 
ing  at  least  adequately,  over  one-third  said  that 
they  needed  ad^tior^  training  on  these  same 
tasks.  This  apparent  discreparKy  was  at  least 
partially  explained  in  written  comments  received 
from  numerous  employees  in  response  to  the 
survey.  Employees  routinely  nraintained  that 
they  simply  caimot  keep  up  with  the  changes 
occurring  in  both  the  F^eral  Acquisition  Regula¬ 
tions  (FAR)  and  agency  implementation  of  these 
regulations.  According  to  one  respondent,  "There 
seems  to  me  to  be  an  exponential  rate  of  growth  in 
the  regulations  governing  the  procurement 
process."  This  growth  in  the  niunber  of  regula¬ 
tions  puts  a  tremendous  burden  on  contract 
speci^ts.  The  result  of  all  of  the  changes  in 
regulations  is  that  training  is  continually  needed 
to  keep  current  with  the  ever-changing  Federal 
contracting  environment.  Many  contract  special¬ 
ists  believ^  the  need  for  training  will  certainly 
increase  as  long  as  the  number  of  regulations 
governing  proouement  actions  continues  to  grow. 


Additionally,  the  results  show  that  both  employ¬ 
ees  and  supervisors  believed  that  a  substantial 
portion  of  the  contracting  specialists  workforce 
need  training  that  is  spe^caUy  focused  on  each  of 
the  20  critical  tasks.  Interestingly,  although 
supervisors,  on  average,  gave  slightly  lower 
performance  ratings,  both  employees  and  supervi¬ 
sors  believed  that  virtually  the  same  percentage  of 
anployees  need  addition^  training  on  each  task. 

Ratings  of  tiie  Abilities  of  Contract 
Specialists 

In  addition  to  collecting  information  concerning 
performaiKe  of  work-related  tasks,  our  survey 
asked  employees  to  rate  themselves  on  nine  basic 
abilities  t^t  were  identified  as  essential  to  p)er- 
forming  the  duties  of  a  contract  specialist  through 
job  analyses  conducted  by  the  Federal  Acquisition 
Institute.  Employees  were  asked  to  rate  them¬ 
selves  using  a  four-point  scale  which  ranged  from 
"1,"  iiKlicating  that  they  believed  that  they  do  not 
possess  an  ability,  to  "4,"  indicating  that  ^ey 
possess  an  ability  to  a  great  extent.  A  rating  of  "3" 
meant  that  they  believed  that  they  {>ossess  an 
ability  to  the  extent  needed  to  adequately  perform 
tasks  requiring  the  ability.  OrKe  again,  ratings  on 
the  same  abilities  were  obtained  from  each 
employee's  supervisor. 

Table  3  presents  the  percentage  of  employees  who 
rated  themselves  as  possessing  each  ability  to  the 
extent  needed  to  adequately  perform  the  tasks 
requiring  each  ability,  as  well  as  the  ratings 
provided  by  their  supervisors.  The  table  also 
shows  the  percentage  of  employees  rated  (by 
themselves  aiKi  their  supervisors)  as  possessing 
each  ability  to  the  extent  needed  to  perform  in  an 
outstaixling  manner. 


( 
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As  reflected  in  this  table,  employees  generally 
believed  that  they  are  well-qualified  to  perform 
their  jobs.  Almost  all  of  them  felt  that  ttiey  pos¬ 
sess  the  abilities  needed  to  perform  their  job  in  at 
least  an  acceptable  manner.  With  regard  to  most 
of  the  abilities,  a  large  number  of  employees 
believed  that  they  have  the  ability  to  do  outstand¬ 
ing  work.  Exceptions  to  this  were  the  abilities  to 
innovate  and  to  conduct  negotiations. 

As  table  3  also  shows,  employees  believed  that 
they  possess  each  of  the  abilities  to  a  somewhat 
greater  degree  than  did  their  supervisors.  In 
every  case  more  employees  rated  themselves  as 
possessing  adequate  or  outstanding  levels  of  eeich 
ability  th^  did  their  supervisors.  In  contrast  to 
the  ratings  provided  by  employees,  the  supervi¬ 
sory  ratings  on  the  nine  essential  abilities  pre¬ 


sented  a  picture  of  a  capable,  but  somewhat  1^ 
than  outstaiKling,  worldorce.  As  seen  in  this 
table,  supervisors  were  uniformly  and  signifi¬ 
cantly  less  likely  to  rate  employees  cis  outstanding 
with  regard  to  each  ability.  In  one  noteworthy 
area,  ability  to  innovate,  supervisors  reported  that 
more  of  their  subordinates  had  less  than  adequate 
levels  of  this  ability  {25  percent),  than  were  rated 
above  average  (22  percent). 

Interestingly,  despite  the  fact  that  they  rated 
themselves  highly  on  almost  eveiy  ability,  many 
employees  felt  that  additional  training  is  needed 
in  each  of  the  nine  areas  if  they  are  to  perform 
their  jobs  well.  Table  4  shows  the  percentage  of 
the  GS-1 102  workforce  seen  as  needing  training  in 
order  to  improve  performance,  by  both  the 
incumbents  themselves  and  their  supervisors. 


Tables 


Self  and  Supervisory  Ratings  of  Abilities  Essential  to  the  Work  of  GS-1102  Employees 
(Percent  of  GS-9  and  Above  Employees  Rated  "Adequate"  and  "Outstanding") 


Ability 

Self  Ratings 

Adequate  Outstanding 

Supervisory  Ratings 
Adequate  Outstanding 

Directing  Work  Activities 

50 

41 

54 

28 

Planning  and  Organizing 

42 

52 

50 

37 

Human  Relations  Ability 

46 

46 

52 

32 

Analytical  AWlity 

47 

45 

48 

37 

Oral  Communications 

47 

46 

52 

37 

Writing  Ability 

46 

46 

51 

33 

Ability  to  Innovate 

54 

32 

53 

22 

Ability  to  Initiate  Action 

48 

45 

50 

34 

Conducting  Negotiations 

48 

36 

49 

33 

Average 

48 

43 

51 

33 
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Table  4 


Percent  of  the  GS-llOS  Workforce  Seen  by  Employees  and  Supervisors  as  Needing  Additional 

Training  in  Abilities  Essential  to  Their  Work 

(Ratings  Provided  for  Employees  at  Grades  GS-9  and  Above) 


Percent  Needing  Training 

Ability 

Employee  Rating 

Supemsor  Eating 

Directing  Work  Activities 

30 

55 

Planning  and  Organizing 

26 

53 

Hiunan  Relations  Ability 

34 

55 

Analytical  Ability 

40 

58 

Oral  Communications 

31 

50 

Writing  Al^ty 

35 

57 

Ability  to  Iimovate 

37 

55 

Ability  to  Initiate  Action 

26 

47 

Conducting  Negotiations 

53 

66 

Average 

35 

55 

Table  4  shows  that  a  sizable  percentage  of  both 
employees  and  supervisors  believed  that  there  is  a 
defiiute  need  for  more  training  in  almost  every 
aspect  of  work  performed  by  contract  specialists. 
However,  perhaps  what  is  most  striking  is  the 
discrepaiKy  between  employees  and  supervisors 
in  terms  of  the  percentage  of  employees  they 
believed  need  training  in  virtually  every  ability. 
Although  supervisors  believed  that  employees 
generally  possess  acceptable  levels  of  the  abilities 
needed  to  perform  their  job,  they  apparently  also 
believed  that  there  is  much  room  for  improve¬ 
ment.  In  foct,  in  almost  every  area,  supervisors 
said  that  the  work  of  over  h^  of  the  people  they 


supervised  could  be  improved  by  additiortal 
training.  By  contrast,  o^y  about  one-third  of  the 
employees  reported  that  they  could  benefit  from 
additional  training.  Both  employees  and  supervi¬ 
sors  agreed,  however,  that  the  area  with  the  most 
room  for  improvement  is  conducting  negotiations. 
For  their  part,  supervisors  also  felt  that  significant 
improvements  could  be  made  through  training  in 
an^ytical  ability  aixl  the  ability  to  write.  This 
assessment  is  p^cularly  important  since  supervi¬ 
sors  frequently  indicated,  in  comments  provided 
to  oiu*  survey,  that  analyzing  and  writing  are  two 
of  the  most  important  abilities  needed  by  contract 
specialists. 
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Research  and  Official  Performance 
Appraisal  Ratings 

Another  important  measure  of  the  quality  of  an 
employee's  work  is  the  official  performance  ap¬ 
praisal  rating  that  a  supervisor  is  required  to  give 
each  subordinate  every  year.  This  is  a  rating 
provided  on  a  five-point  scale,  running  from 
"unsatisfactory"  (or  "1")  to  "outstanding"  (or  "5"). 
Theoretically,  a  rating  of  "fully  successful"  (or  "3") 
is  a  good  rating  indicating  that  the  employee  is 
performing  the  job  that  be  or  she  is  supposed  to  do 
in  an  acceptable  manner.  In  actual  practice,  how¬ 
ever,  the  majority  of  employees  in  the  Federal 
Government  receive  ratings  higher  than  "fully 
successful."'® 

In  order  to  gather  data  about  these  ratings  for 
contract  specialists,  we  asked  employees  what 
rating  they  had  received  during  their  most  recent 
formal  performance  appraisal.  In  response  to  this 
question,  31  percent  s^  that  they  had  been  rated 
"outstanding'  and  45  percent  "exceeds  fully 
successful."  Only  24  percent  indicated  that  they 
had  been  rated  "fully  successful."  Fewer  than  1 
percent  said  that  they  had  been  rated  "less  than 
fully  successful."  These  same  respondents  re¬ 
ported  similar  distributions  of  ratings  for  each  of 
the  previous  2  years  as  well'* 


In  our  opinion,  the  formal  performaiKe  rating 
given  to  the  employee  each  year  can  be  influenced 
by  a  number  of  factors  other  than  the  employee's 
work  performance.  In  fact,  research  by  OPM  has 
shown  that  when  supervisors  were  asked  to 
provide  confidential  ratings  on  the  performance  of 
employees  they  supervised,  these  ratings  were 
significantly  different  from  the  official  performance 
rating  they  gave  the  employee.'®  Accordingly,  we 
adapted  six  rating  scales  for  use  with  the  procure¬ 
ment  function  fi-om  the  scales  used  by  OPM  in 
their  studies  of  workforce  quality.'®  We  asked  each 
employee's  supervisor,  for  pvuposes  of  our  re¬ 
search,  to  provide  confidential  ratings  of  their 
subordinate's  work  on  each  of  these  six  dimen¬ 
sions.  Each  supervisor  was  also  asked  to  provide 
an  overall  research  rating  assessing  each 
employee's  contribution  to  the  orgaiuzation.  As  is 
done  when  providing  an  employee  with  an  official 
performance  rating,  supervisors  were  asked  to  rate 
employees  on  a  five-point  scale,  with  a  "1"  being 
assigned  to  the  lowest  rating  and  a  "5"  to  the 
highest.  Table  5  shows  the  average  most  recent 
official  rating  as  reported  by  employees.  It  also 
presents  the  average  ratings  provided  by  supervi¬ 
sors  for  their  subordinates  on  each  of  the  six 
confidential  research  rating  scales  and  the  overall 
research  rating  given  to  members  of  the  contract 
specialist  workforce. 


”  us.  Merit  Systems  Protection  Board,  *Toward  Effective  Performance  Management  in  ttie  Federal  Government'  July  1988,  p.  8. 

**  Comparable  percentages  of  employees  receiving  ratings  above  'fully  successful'  have  been  reported  for  other  occupational  series  in  the 
Federal  Government.  In  US.  Office  ot  Personnel  Management,  'Scientists  and  Engineers  in  Qvilian  Agencies:  Study  of  Quality-Related 
Factors  (1990),'  Kept  Na  WQR  91-01,  March  1991,  p.  15,  it  is  reported  fiiat  66  percent  of  these  employees  received  ratings  above  'fully 
successful.*  Similarly,  U5.  Office  of  Personnel  Management  'Computer  Specialists  in  Federal  Agendas:  Study  of  Quality-Related  Factors,' 
Rept  Na  WQR  91-02,  June  1991,  p.  23,  reports  that  69  percent  of  the  employees  working  in  this  area  received  ratings  above  'fully  suocess- 
fol.' 

**  Jay  Gandy,  'Quality  of  PAC  Hires:  Job  Performance  and  Other  Indicators  for  1983-1986  >^>pcintments  in  Professional  and  Administra¬ 
tive  Career  (PAQ  Occupations^'  US.  Of^  of  Personnel  Management  Rept  No.  WQR  90-1,  June  1990. 

**  For  other  studies  in  workforce  quality  using  confidential  ratings  of  std>ofdinate  performance  see:  U5.  Office  of  Personnel  Manage¬ 
ment  '^Scientists  and  Engineers  in  Qvilian  Agendes:  Study  of  Quality-Rdated  Factors  (1990),'  Kept  No.  WQR  91-01,  Mardi  1991;  aitd  U5. 
Office  of  Personnel  MaiMgennent  'Computer  Specialists  in  Federal  Agencies:  Study  of  Quality-Related  Factors,'  Rept.  No.  WQR  91-02,  June 
1991. 
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Table  5 

Most  Recent  Official  Rating  and  Mean  Research  Ratings  for  GS-1102  Employees 

Moat  Rfitent  Official  Appraisal  Rating 

4.07 

Mean  Research  Ratings 

Quantity  of  Work  Performed 

3.63 

QualiQrofWmic 

Variety  of  Assignments  Handled 

3.66 

Concern  with  Meeting  Customer  Needs 

4.00 

Creativity  of  Work 

3.40 

Possession  of  Required  Skills/ 

Mean  of  Six  Research  Rating  Elements 

3.74 

Overall  Research  Rating 

3.72 

As  table  5  shows,  compared  to  the  official  perfor¬ 
mance  appraisal  ratings,  supervisors  frequently 
gave  lower  ratings  to  their  subordinates  when 
asked  to  provide  confidential  research  ratings  of 
employee  performance.  To  some  extent,  this  may 
reflect  inflation  in  the  official  performance  ap¬ 
praisal  ratings.  Employees  not  only  receiv^ 
significantly  lower  overall  research  ratings  than 
official  ratings  but,  as  shown  in  figure  2,  there  was 
also  a  more  evoi  distribution  for  ffie  overall 
research  ratings  than  for  the  official  ratings. 
Considerably  fewer  employees  were  rated  in  the 
"highly  successful"  (4)  category,  and  many  more 
employees  were  rated  "minimally  successful"  (2) 
in  the  overall  research  ratings  than  in  the  official 
ratings. 


Although  inflation  in  the  official  performance 
appraisal  ratings  may  accoimt  for  some  of  the 
difference  between  those  ratings  and  the 
confidential  research  ratings,  it  does  not  accoimt 
for  all  of  the  difference.  If  it  did,  there  would  be  a 
strong  statistical  relationship  between  the  two 
types  of  ratings  (ie.,  onployees  who  received  high 
official  ratings  would  most  frequently  receive  high 
research  ratings  and  employees  who  received  low 
official  ratings  would  tend  to  get  low  research 
ratings). 

While  there  were  statistically  significant  relation¬ 
ships  between  an  employee's  most  recent  official 
rating  and  each  of  the  six  confidential  research 
rating  provided  for  that  employee,  the  amount  of 
similarity  between  the  ratings  was  surprisingly 
small  (le.,  employees  who  received  high  official 
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FIGURE  2.  DISTRIBUTION  OF  OFFICIAL  AND 

AVERAGE  RESEARCH  RATINGS 
FOR  GS-1102  EMPLOYEES 


I  Ornekil  P«rformane«  Ratinot  D  Av«rao«  RMParch  Rcrtlno* 


ratings  often  did  not  receive  similarly  high  One  possible  reason  for  the  difference  between 

research  ratings).’^  Similar  relationships  between  official  ratings  and  the  research  ratings  is  the  fact 
official  aiKl  research  ratings  have  been  reported  in  that  employees  provided  the  information 
research  conducted  by  OPM**  concerning  their  latest  official  rating.  If  employees 

Acrow  tfte  six  researdi  dimensions  the  oorreblion  ooeffidenis  with  the  official  ndng  ranged  from  (concern  widi  meeting 

customeis  needs)  to  rs3S  (quantity  of  work  performed).  The  ooneiation  coefficient  betwm  the  overall  research  rating  and  the  of^al 
rating  was  r=.37.  in  eadi  case  foe  comlation  coefficients  were  significant  at  the  p.<  .01  level. 

**  Jay  Candy,  Walter  Marm,  aitd  Alice  Outcrtrridge,  *7ob  perforanance  criteria  artd  biodata  validity:  Comparisons  and  considerations^'’  In 
J.C  Sharf  (Chair),  'Irmovative  researdi  on  die  lAR:  The  first  Fedend-svide  biodata  fonn,”  SynqxMium  conducted  at  the  fifdi  aruiual 
eonfcretroe  of  the  Scxiely  for  industrial  and  Otganiza  donal  Psychology,  Miami  Beach,  R,  April  1 990,  p.  5. 


A  Report  Inf  the  U.S.  Merit  Systems  Protection  Board 


15 


Quality  in  Procurement:  Views  from  the  Workforce 


were  not  accurate  in  reporting  this  information, 
this  could  accoimt  for  some  of  the  differeiKes 
between  the  two  types  of  ratings.  Results  from 
other  studies  indicate,  however,  that  employees 
do  tend  to  be  accurate  in  providing  this  type  of 
information.'*  It  is  possible,  however,  that  some  of 
the  difference  between  the  two  types  of  ratings 
could  have  resulted  from  some  employees  having 
changed  supervisors  between  the  time  of  their 
most  recent  official  performance  rating  and  when 
we  conducted  this  survey.  It  is  unlikely,  however, 
that  this  would  have  happened  frequently  enough 
to  account  for  all  of  the  difference. 


the  quality  of  the  work  performed  by  their  subor¬ 
dinates  was  superior.  Additionally,  when  ques¬ 
tioned  about  the  ability  of  their  subordinates  to 
handle  multiple  job  operations,  60  percent  said 
that  their  subordinates  could  efficiently  perform 
many  different  assignments.  Moreover,  70  per¬ 
cent  felt  that  their  employees  almost  always 
maintained  a  positive  service  orientation  towards 
clients  and  colleagues.  Only  in  the  area  of 
creativity  were  supervisors  somewhat  negative,  as 
only  44  percent  said  that  the  work  of  their  subordi¬ 
nates  showed  a  high  degree  of  creativity. 


Based  upon  these  results  we  can  conclude  that 
official  performance  ratings  and  the  confidential 
resecurch  ratings  do  not  measure  all  of  the  same 
aspects  of  the  quality  of  an  employee's  work 
performance.  While  we  cannot  say  definitively 
that  the  research  ratings  provide  more  accurate 
assessments  of  the  quality  of  the  work  performed 
by  a  given  employee  than  the  official  performance 
rating,  it  is  clear  that  the  different  types  of  ratings 
result  in  somewhat  different  assessments  of 
performance.  Taken  together  the  two  types  of 
ratings  probably  provide  a  more  complete  picture 
of  the  quality  of  an  employee's  work  than  would 
otherwise  be  available.  The  point  is  that  in  assess¬ 
ing  the  quality  of  work  performance  among 
procurement  professionals,  and  presumably  other 
occupations,  it  is  important  not  to  rely  solely  on 
official  performance  appraisal  ratings. 

Despite  supervisors'  tendency  to  give  lower 
research  ratings  than  official  ratings,  the  research 
ratings  we  obtained  were  still  fairly  high.  In  fact, 
over  59  percent  of  the  employees  received  average 
research  ratings  that  placed  Aem  in  a  category 
above  "fully  successM."  In  response  to  one 
question,  over  92  percent  of  the  supervisors  also 
said  that  the  employees  they  supervise  make 
efficient  use  of  time.  Another  64  percent  said  that 


Factors  Related  to  Contract  Specialist 
Workforce  Quality 

Educational  CJiaracteristics  of  Contract 

Specialists 

In  addition  to  analyzing  ratings  on  abilities, 
performance  of  job-related  tasks,  and  overall 
performance,  we  attempted  to  look  at  a  number  of 
additional  factors  that  could  be  related  to  the 
quality  of  work  performed  by  Federal  contract 
sped^ists.  This  effort  included  collecting  informa¬ 
tion  from  GS-1102  incumbents  concerning  their 
formal  educational  backgrounds,  awards  they 
have  received,  and  Government  training  courses 
they  have  completed. 

An  issue  of  some  concern  among  senior  manage¬ 
ment  officials  in  procurement  was  the  level  of 
education  completed  by  people  working  in 
procurement.  In  discussions  held  with  these 
officials  when  we  were  plaiming  this  study,  they 
suggested  that  too  few  of  the  people  entering  the 
GS-1102  series  during  the  last  10  to  15  years  have 
completed  sufficient  levels  of  education  to  prepare 
them  to  perform  their  work.  According  to  at  least 
some  of  these  senior  officials  all  contract  specialists 


"  us.  Office  of  Personnel  Management,  "Computer  Specialists  in  FMeral  Agencies:  Study  of  Quality-Related  Factors  (1990),"  Kept  No. 
WQR  91-02,  June  1991,  p.  21 . 
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Table  6 

Highest  Level  of  Education  Cranpleted  by  Cuirent  GS-1102  Employees 

Highest  Education  Level  Completed 

Peicent 

Less  than  High  School 

0.1 

High  School  Gradiiate 

15.9 

Some  College 

27.1 

Bachdor's  Degree 

29.1 

Some  Graduate  School 

11.8 

Mastei^s  Degree 

143 

Ph.D.  or  Other  Professional  Degree 

1.6 

should  possess  at  least  an  undergraduate  college  fact  that  employees  with  more  years  of  service 

degree.  The  highest  levels  of  education  completed  would  also  have  had  more  time  to  earn  a  college 

for  persons  working  in  the  GS-1 102  series  are  degree  after  becoming  procurement  specialists, 

shown  in  table  6. 

Self  reports  of  grades  obtained  in  school  also 
Given  the  concerns  expressed  to  us  by  senior  suggest  that  employees  did  quite  well  in  the 

officials  in  procurement,  it  is  somewhat  surprising  course  of  getting  their  degrees.  The  overall  grade 

to  note  that  over  half  (57  percent)  of  the  people  point  average  (GPA)  reported  by  contract  special¬ 
working  in  this  area  have  earned  at  least  a  ists  who  completed  college  was  3.13  on  a  four- 

bachelor's  degree  and  about  one  in  sbc  has  ob-  point  scale.  Moreover,  the  GPA  for  the 

tained  at  least  a  master's  degree.  There  is  some  employee's  last  2  years  was  3.29  and  3.35  in  his  or 

evidence,  however,  to  support  the  contention  of  her  major  field.  Additionally,  more  than  75 
many  senior  procurement  managers  that  persons  percent  of  the  employees  reported  that  they  were 
entering  the  GS-1 102  series  during  the  last  10  to  15  in  the  top  25  percent  of  their  graduating  class, 

years  are  somewhat  less  likely  to  have  achieved 

the  educational  level  attained  by  those  who  While  survey  responses  make  it  clear  that  most 

entered  the  contract  sp>ecialist  workforce  before  contract  specialists  have  completed  at  least  some 
that  time.  In  fact,  a  breakdown  by  length  of  time  college,  an  additional  potentially  important 

working  in  the  GS-1 102  series  revealed  that  over  question  is  whether  the  education  they  have 
61  percent  of  the  persons  working  in  this  series  for  completed  is  in  any  way  related  to  the  procure- 
15  or  more  years  have  attained  at  least  a  bachelor's  ment  work  that  they  are  asked  to  perform.  For 

degree.  By  comparison,  slightly  fewer  than  53  this  reason,  we  asked  employees  whether  they 

percent  of  the  people  entering  this  series  during  had  completed  a  variety  of  courses  which  might 
the  last  15  years  have  completed  the  same  level  of  be  relevant  to  work  in  this  field.  Table  7  shows 
education.  It  is  possible,  however,  that  some  of  the  percentage  of  employees  in  the  GS-1 102  series 

the  difference  in  the  percentage  of  employees  who  have  completed  undergraduate  or  graduate 

possessing  a  college  degree  may  be  relat^  to  the  courses  which  might  be  considered  related  to  the 

procurement  function. 
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Tkble7 

College  Courses  Completed  by  GS-1102  Employees 

Percent  Completing  Course 

Cpuim  Title 

Undergraduate 

Giaduate 

Marketing 

34 

4 

Accounting 

49 

5  ■ 

Business  N^nagement 

43 

7 

Business  Statistics 

30 

4 

Business  Economics 

37 

5 

Other  Business 

38 

5 

Banking  aiul  Finance 

24 

3 

Operations  Research 

7 

1 

Mathematics 

45 

3 

Computer  Sdence 

26 

2 

Economics 

44 

5 

Political  Science 

28 

2 

Prindples  of  Contracting 

28 

2 

Contract  Law 

41 

3 

As  this  table  illustrates,  the  vast  majority  of  the 
incumbents  in  GS-1102  positions  have  completed 
at  least  some  college-level  course  work  which  may 
be  related  to  their  work  as  contract  specialists. 
Nevertheless,  fewer  than  half  have  completed  a 
large  number  of  procurement-related  college 
courses  (i.e.,  six  or  more  courses).  It  is  also  worth 
noting  that  the  likelihood  of  completion  of  college 
courses  in  these  areas  varied  by  length  of  service. 
Persons  with  less  experience  in  the  procurement 
field,  on  average,  have  completed  fewer  of  these 
college  courses. 

In  our  discussions  with  senior  procurement 
officials  several  of  them  suggested  that  the  quality 
of  the  procurement  workforce  could  be  improved 
by  establishing  new  minimum  qualification 


standards  for  people  entering  the  GS-1102  series. 
Their  proposal  induded  limiting  hiring  for  entry- 
level  positions  in  the  GS-1102  series  to  college 
graduates  or  to  persons  who  have  completed  at 
least  24  hours  of  college  courses  in  related  sub¬ 
jects.  To  the  extent  that  it  can  be  shown  that 
coursework  in  related  fields  is  related  to  perfor¬ 
mance,  it  is  possible  that  the  quality  of  new 
entrants  to  ffie  contract  specialist  workforce  could 
be  improved  by  this  requirement.  It  should  be 
noted,  however,  that  according  to  our  results, 
only  about  40  percent  of  the  current  GS-1 102 
workforce  would  meet  the  requirement  of  24 
hours  of  related  coursework.  More  importantly, 
an  analysis  of  the  relationship  between 
completion  of  these  courses  and  work 
performance  revealed  that  there  is  only  a  minimal 
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relationship  between  the  number  of  these  courses 
the  person  has  completed  and  the  various  assess¬ 
ments  of  his  or  her  performance.  In  a  way  this 
fiiKling  is  not  siuprising.  According  to  supervi¬ 
sors  responding  to  our  survey,  the  performance  of 
contract  specialists  often  depends  upon  their 
ability  to  think  analytically  and  write  clearly. 
Competence  in  these  abilities  may  be  demoiv- 
strat^  in  a  variety  of  courses,  from  sdeiKe  to 
English,  and  not  just  in  those  that  would  appear  to 
be  directly  related  to  procurement  work. 

Completion  of  Government-Sponsored  'lYaiiung 
Courses 

In  addition  to  having  completed  college  courses, 
persons  in  procurement  may  have  completed 
Government-provided  traiiung  courses  which 


were  intended  to  prepare  them  to  do  their  jobs. 
These  courses  differ  ^m  those  that  are  offered 
through  colleges  or  universities  in  that  they  are 
typically  shorter  in  nature  and  focus  on  a  par¬ 
ticular  aspect  of  Federal  procurement.  The 
percentage  of  incumbents  who  reported  having 
completed  formal  Govenunent-provided  traiiv- 
ing  in  a  variety  of  general  procurement-related 
areas  is  shown  in  table  8. 

Qearly,  most  of  the  people  working  in  this  area 
have  completed  training  in  the  basic  procure¬ 
ment  areas.  Considerably  fewer,  however,  have 
completed  advanced  courses.  Presumably  the 
more  traiiung  completed  the  better  prepared 
employees  should  be  to  perform  their  jobs  well. 
In  foct,  analyses  using  the  various  ratings  of 
performance  that  were  discussed  earlier  in  this 


Table  8 

Completion  of  Government  Training  in  Procurement  by  GS-1102  Employees 

Training  Area 

Percent  Completing 

Basic  Procurement  Management 

81 

Advanced  Procurement  Management 

51 

Contract  Administration 

70 

Advanced  Contract  Administration 

38 

Cost  and  Price  Analysis 

81 

Advanced  Cost  and  Price  Analysis 

19 

Government  Contract  Law 

74 

Small  Purchases 

63 
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study  showed  that  there  was  indeed  a  statistically 
significant  relationship  between  the  number  of 
training  courses  completed  and  each  of  the  ratings 
of  performance.  This  was  true  regardless  of 
whether  the  ratings  were  provided  by  incumbents 
or  their  supervisors. 

Likelihood  of  completion  of  these  courses  to  some 
extent  varied  by  agency.  Although  discussions  toUh 
procurement  personnel  repealed  the  expectation  that 
persons  toorkingfor  the  D^ense  agencies  (ia.,  the 
Army,  Navy,  Air  Force,  and  Defense  Lefties  Agency) 
woidd  be  more  likely  to  have  completed  training, 
particularly  advan^  training,  this  did  not  prove  to  be 
the  case.  In  fact,  we  found  very  few  differences 
between  employees  working  for  E)efense  agencies 
and  those  worl^g  for  non-Defense  agencies. 
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Awards  Received  by  Members  of  the  GS-1102 
Wcgkforce 

Receipt  of  some  type  of  award  diuing  1990  was 
reported  by  ahnost  two-thirds  of  the  procurement 
workforce.  Some  47  percent  reported  receiving  at 
least  one  award  during  1989.  Table  9  breaks  down 
these  totals  by  type  of  award. 

To  the  extent  that  awards  are  a  good  indication  of 
high-quality  work,  employees  in  the  GS-1102 
series  are  certainly  doing  a  good  job.  Given  the 
distribution  of  official  performance  appraisal 
ratings  that  was  discussed  earlier,  it  is  not  surpris¬ 
ing  that  a  high  percentage  of  incumbents  received 
performance  awards.  Perhaps  even  more  impor¬ 
tantly,  statistical  analysis  revealed  that  the  to^ 
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Percent  of  GS-1102  Employees  Receiving  Awards  During  the  Past  24  Months 


Type  ol  Award 

Most  Recent 

12  Months 

12Monttis 

Preceding 

Performance 

48.0 

31.3 

Beneficial  Suggestion 

2.4 

3.7 

Special  Act 

13.5 

IZl 

Qu^ty  Step  Increase 

16.1 

9.4 

Sustained  Superior  Perf. 

15.8 

14.8 

SES  Presidential  Rank 

0.1 

0.2 

Professional  Society 

0.8 

0.1 

Foundation 

0.1 

0.1 

Other  Awards 

4.4 

1.8 

Note:  The  percentages  can't  be  summed  to  the  total  percentage  of  the  GS-1 102  workforce  receiving 
awards  since  individuals  may  have  received  more  than  one  award. 
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numbo'  of  awards  received  by  a  person  was 
strongly  related  to  both  self  and  supervisory 
assessments  of  performance  in  our  study. 

Other  Factors  Affecting  the  Quality  of  Work  in 
Federal  Procurement 


There  is  an  incredibly  large  body  of 
procurement  laws,  regulations,  arid 
procedures  to  know  and  keep  current  on.  It 
is  very  difficult  between  formal  training 
sessions  to  keep  current  and  educated  on  the 
many  changes  that  occur  in  Federal 
contracting. 

— A  survey  respondent 


Based  on  the  results  just  presented,  it  is  clear  that 
in  terms  of  the  direct  match  between  critical  job 
requirements  and  workforce  characteristics,  both 
supervisors  and  employees  believe  that  the 
quality  of  the  procurement  workforce  is  at  least 
adequate  if  not  superior.  Even  so,  supervisors,  in 
particular,  believed  that  there  was  substantial 
room  for  improvement  as  indicated  by  their  belief 
that  significantly  more  training  is  needed  for  large 
portions  of  the  workforce.  Perhaps  even  more 
importantly,  comments  provided  by  both  employ¬ 
ees  aiKl  supervisors  in  response  to  our  survey 
revealed  that  there  were  a  number  of  potenti^y 
substantial  problems  which  both  groups  believed 
limited  the  quality  of  the  work  performed  by 
contract  spedalists.  LiteraUy  thousands  of 
comments  were  received  from  both  employees 
and  supervisors,  many  of  whom  repeated  the 
same  themes.  In  oiu  view,  even  though  we 
cannot  provide  definitive  information  about  the 
pervasiveness  of  the  concerns  raised  in  the  written 
comments,  the  perspective  they  provide  is  an 
important  back^op  against  whi^  to  evaluate 
data  obtained  from  our  surveys. 

As  mentioned  earlier,  one  recurrent  theme  among 
the  comments  provided  by  employees  was  the 
belief  that  they  are  being  overwhelmed  by 
changes  to  the  procurement  process.  To  quote 


one  employee,  "Contract  Specialists  are  over¬ 
whelmed  by  laws  and  regulations  aiKi  are  under 
very  close  scrutiny  of  the  public.  All  of  this  goes 
into  making  it  a  very  stressful  job."  Still  another 
employee  complained,  "On  average,  I  read  50  to 
60  pages  of  regulation  changes  ea^  week." 

According  to  many  of  the  contract  specialists 
providing  written  comments  in  response  to  our 
survey,  this  situation  was  frequently  made  even 
more  difficult  siiKe  either  adequate  iiK)ney  for 
training  was  not  available  or  their  work  Ic^  was 
so  heavy  that  they  were  not  permitted  to  take  the 
time  to  attend  training.  Moreover,  some  of  these 
same  employees  believed  that  the  quality  of  the 
traiiting  they  did  receive  was  poor.  According  to 
these  employees,  the  training  they  received  was 
too  simplifi^  and  not  sufficiently  specific  to  meet 
their  n^ds.  Other  employees  expressed  concern 
that,  because  of  the  lade  of  suMdent  training,  the 
Government  was  put  at  a  significant  disadvantage 
when  they  engag^  in  negotiations  with  their 
counterparts  from  the  private  sector.  All  of  this 
added  to  the  pressure  that  many  contract  special¬ 
ists  said  was  a  daily  part  of  their  jobs.  According 
to  these  employees,  ftere  was  constant  pressure  to 
do  things  more  quickly  while  at  the  same  time 
their  workload  was  such  that  they  felt  that  they 
could  barely  keep  afloat. 

From  the  perspective  of  the  supervisors  who 
provided  written  comments,  the  main  problems 
facing  the  procurement  workforce  were  the 
volume  of  the  work  and  the  complexity  of  the 
procurement  process.  Of  course,  these  problems 
are  interrelated.  As  was  the  case  with  the  contract 
specialists  themselves,  these  supervisors  reported 
that  the  procurement  process  h^  become  so 
complex  that  even  the  small  procurement  actions 
can  take  an  inordiiute  amovmt  of  time  aiKl  involve 
excessive  paperwork.  According  to  one  supervi¬ 
sor,  "The  procurement  system  needs  a  complete 
overhaul.  Contract  specialists  are  so  hamstrung 
by  rules  and  oversight  that  they  caimot  buy  what 
we  need  in  a  timely  maruier."  Once  again  this 
was  a  theme  that  was  frequently  repeated  by 
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many  of  the  supervisors  providing  written 
conrunents.  From  the  perspective  of  these  supervi¬ 
sors,  there  are  so  nnany  rules  that  contract  special¬ 
ists  in  many  agencies  have  little  or  no  discretion. 
Unfortunately,  these  same  supervisors  thought 
that  this  sometimes  resulted  in  decisions  that 
seenungly  made  little  business  sense. 

The  iiKreasing  complexity  of  the  procurement 
process  frequently  has  aix  had  the  effect  of 
lengthening  the  procurement  process  and,  as  a 
result,  there  is  constant  pressure  from  manage¬ 
ment  to  speed  up  a  process  that  has  been  slowed 
down  by  regulatory  requirements.  According  to 
some  employees,  tlus  h^  sometimes  resulted  in  a 
tendency  for  management  to  put  tremendous 
pressure  on  contract  specialists  to  bend  the  rules. 
As  one  supervisor  said: 

Nearly  all  GS-1102's  want  and  try  to  do 
the  b«t  they  can,  but  there  are  so  many 
laws  and  regulations  which  result  in 
over  control  of  Government  contracting, 
which  leads  to  impatience  in  project 
control  officials,  who  then  pressure 
contract  specialists  to  short  cut  the 
process. 

For  nrany  employees  the  situation  becomes  all  but 
intolerable  at  the  end  of  the  fiscal  year,  when 
organizations  are  coiKemed  with  spending  all  of 
the  money  allocated  to  them  so  that  they  will  not 
lose  this  money  or  have  their  budgets  cut  the 
following  year.  In  their  written  comments,  a 
number  of  respoiKlents  told  us  that  their  organiza¬ 
tions  were  more  interested  in  obligating  all  of  the 
money  they  were  budgeted  before  the  end  of  each 
year  than  they  were  in  making  sure  that  procure¬ 
ments  were  made  in  corrfornumce  with  applicable 
rules  and  regulations.  As  one  respondent  noted, 
"The  largest  obstacle  procurement  professionals 
foce  is  pressure  of  management  to  do  other  than 
what  b  required  by  law  aiui  regulation."  Accord¬ 


ing  to  another  "We  are  encouraged  every  day  to 
break  laws,  not  just  regulations,  in  order  to  obli¬ 
gate  more  dollars."  Quite  a  few  supervisors  were 
also  concerned  about  thb  issue.  According  to  one 
supervisor.  "The  biggest  problem  I  see  in  contract 
specialbte  b  the  pressure  to  obligate  dollars 
instead  of  writing  good  contracte." 

At  the  same  time  that  contract  spedalbte  are  being 
pressured  to  complete  contracb  and  obligate 
dollars  more  quiddy,  their  agencies  are  legally 
responsible  for  the  integrity  of  the  contracb  they 
write.  E)espite  pressures  of  the  sort  described  in 
their  written  commenb,  apparently  most  employ¬ 
ees  recognized  that  breaking  the  rules  b  not  an 
acceptable  response  since  very  few  employees 
(only  7  percent)  responded  to  our  survey  by 
disagreeing  with  the  statement  that  the 
contracting  activities  for  which  they  were  respon¬ 
sible  were  always  completely  legal  and  defensible. 

In  fact,  discussions  with  senior  procurement 
offidab  concerning  the  interpretation  of  survey 
resulb  suggested  that  the  emphasb  on  legal  and 
defensible  contracb  may  be  so  great  in  some 
organizations  that  it  has  become  the  overriding 
coiKem  in  the  minds  of  many  contract  specialbb. 
According  to  the  written  commenb  provided  by 
one  supervisor  'Tlaying  it  safe  and  by  the  book  b 
what  geb  rewarded."  Thb  b  not  to  say  that 
supervisors  were  suggesting  that  employees 
should  break  the  rules,  oiUy  that  the  emphasb  has 
shifted  horn  finding  legal  ways  of  meeting  the 
needs  of  the  organization  to  being  sure  to  protect 
oneself.  One  supervisor  summed  up  thb  feeling 
by  saying:  "The  whole  measure  of  a  contract  now 
b  not  whether  it  b  timely,  cost  effective,  or  obtains 
the  Government' s  requirement,  but  whether  it  can 
sustain  a  protest." 

Although  it  b  certainly  important  for  a  contract  to 
be  able  to  stand  in  the  face  of  a  protest,  too  much 
emphasb  on  protecting  oneself  apparently  fosters 
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a  closed-minded  approach  to  contracting.  Ac¬ 
cording  to  many  supervisory  comments,  this  type 
of  thinl^g  leads  to  an  authoritarian  adbrcement 
mentality  where  contract  specialists  rigidly  apply 
the  rules  that  they  have  leained,  often  without 
adequate  understanding  of  the  options  available 
to  th^m  and  sometimes  even  wittiout  a  sufficient 
appreciation  of  the  missions  of  the  organizations 
they  support  This  type  of  thinking  probably  also 
contributes  to  the  belief  held  by  many  supervisors 
that  their  subordinates  lack  the  ability  to  innovate 
(see  tables  3  and  4)  and  lack  creativity  (see  table  5). 

A  number  of  incumbents  apparently  shared 
similar  concerns.  Several  noted  in  their  written 
conunents  that  the  proliferation  of  regulations  has 
had  the  effect  of  stifling  their  creativity  and  iiUubit- 
ing  their  ability  to  be  responsive  to  the  needs  of 
their  organization.  As  one  resporvlent  put  it: 

[We]  are  severely  discouraged  from 
utilizing  discretion  through  either  the 
requirements  for  extensive  higher 
review  aiul  documentation  and/or 
dowiuight  fear  of  reprisal  for  even 
suggesting  a  FAR  [Federal  Acquisition 
Regulations]  authorized  deviation  from 
their  organization's  norm  ••• .  The 
culture  is  to  blitKlly  follow  the  estab¬ 
lished  routine  without  any 
consideration  of  the  taxpayers  who  pay 
them  and  the  people  in  the  field  whom 
they  ultimately  serve. 

Based  upon  both  survey  responses  and  written 
comments,  it  appears  that  while  supervisors 
believed  that  most  of  the  people  who  worked  for 
them  had  the  ability  to  perform  the  tasks  required 
of  them  uTKler  the  best  of  cotKlitions,  they  al^ 
thought  that  their  subordinates  seldom  possessed 
the  abilities  needed  to  devise  creative  legal  solu¬ 
tions  to  organizational  problems  given  the  situa¬ 


tions  in  which  they  typically  AikI  themselves.  As 
a  result  of  the  complexity  of  the  F^eral  procure¬ 
ment  system  and  organizational  pressure  to 
obligate  all  allocated  money,  contract  specialists 
are  frequently  faced  with  a  dilemma  of  how  to 
provide  the  service  required  by  their  organization 
without  breaking  the  rules.  Unfortunately,  under 
these  corrditions  it  appears  that  only  those  em¬ 
ployees  possessing  an  unusual  amount  of  analyti¬ 
cal  ability  and  creativity  are  able  to  successfully 
meet  both  of  these  goals.  According  to  supervi¬ 
sors,  employees  possessing  these  abilities  to  a 
lesser  extent  typically  either  chose  to  beivd  the 
rules  or  developed  an  inflexible  approach  to 
contracting  that  often  alienated  managers  in  the 
orgairizations  in  which  they  work. 

Changes  in  Workforce  Quality  Over  Tune 

As  a  result  of  the  increased  complexity  of  the 
procurement  process  and  the  n^  to  deal  with 
moimting  pressure  horn  maiuigement,  many 
supervisors  suggested  in  their  comments  that 
tody's  average  contract  specialist  must  be  even 
more  capable  than  the  contract  specialist  of  10  to  15 
years  ago.  Unfortunately,  some  supervisors  also 
thought  that  rather  than  improving,  the  quality  of 
new  entrants  to  the  GS-1102  series  has  actually 
declined.  This  is  a  view  that  MSPB  has  found  to 
be  common  among  Federal  sujTervisors  in  other 
occupational  series.® 

Although  not  perfect,  one  way  we  can  begin  to  get 
some  indication  of  possible  changes  in  quality 
over  time  is  to  compare  persons  who  entered  the 
GS-1 102  series  at  different  times  to  see  if  they 
differ  in  terms  of  their  performance  ratings  and 
the  various  quality  indicators  included  in  this 
study.  Table  10  compares  the  official  performance 
appraisal  ratings  arui  average  research  ratings  for 
persons  having  different  lengths  of  service  in  the 
C3S-1102  occupational  series. 


*  us.  Merit  Syatons  Protection  Board,  'Working  for  America:  A  Federal  Employee  Survey,"  June  1990,  p.  7. 
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Table  10 

Perfonnance  Appraisal  Ratiitgs  and  Research  Ratings  by  Lengtii  of  GS-1102  Service 

Lengttiol 

Average  Official 

Average  Research 

Service 

Perfonnance  Rating 

Rating 

0-3  Years 

3.97 

3.69 

4>6Yeais 

3.81 

7-9  Years 

4.12 

3.82 

10-14  Years 

4.16 

3.91 

15-20  Years 

4.12 

3.92 

21  or  More  Years 

4.20 

3.88 

Overall  Average 

4.09 

3.82 

Although  the  trend  for  both  ratings  is  oolainly  in  We  made  a  similar  comparison  between  teniure 

the  dir^on  of  higher  ratings  for  employees  who  groups  using  some  of  the  other  quality-related 

have  the  longest  service,  statistical  tests  show  that  factors  sud\  as  employees'  education^ 

theonly  group  with  significantly  different  ratings  diaiacteristics,  training,  and  awards.  The  results 
are  the  employees  with  3  years  or  less  experience.  of  these  analyses,  whi^  are  presented  in  table 

In  both  cases,  this  group  received  lower  ratings.  11,  revealed  several  difterences  among  the 

Given  the  fact  that  only  the  group  with  the  le^  groups.  Employees  with  15  or  more  years  of 

experience  received  lower  ratings,  it  is  likely  that  experience  were  somewhat  more  likely  to  have 

this  difference  reflects  the  fact  that  this  group  b  received  a  bachelor's  degree  than  were  employ- 
primarily  composed  of  trainees  who  are  still  ees  with  less  experience.  Additionally,  employ- 

learning  the  work  required  of  contract  spedalista  ees  with  6  or  fewer  years  of  service  were  less 

As  such,  it  should  not  be  surprising  that  they  likdy  to  have  completed  advanced  degrees, 

received  somewhat  lower  ratings.  To  some  extent, 
the  treiKl  for  groups  with  longer  lengths  of  service 

to  receive  higher  ratings  b  explained  by  the  fact  In  other  findings  related  to  education,  although 

that  higher  graded  employees,  who  generally  also  employees  who  have  been  working  as  contract 

have  longer  service,  tend  to  receive  higher  perfor-  spedalbts  for  15  or  more  years  were  found  to 

mance  ratings.  It  b  not,  therefore,  surprising  that  have  lower  CPA's,  there  were  no  significant 

the  group  with  the  least  experience  received  the  differoKes  among  groups  in  terms  of  class 

lowest  ratings.  Thb  group  b  primarily  composed  staixiing.  Additionfdly,  the  groups  did  not  difier 

of  Iowa*  graded  emf^oyees  who  are  in  many  cases  in  terms  of  their  reported  grades  in  high  school 
trainees  who  are  still  learning  the  work  required  of  or  the  number  of  procurement-related  courses 
contract  spedalbts.  they  had  complete. 
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TABLE  11 


QUALITY  FACTORS  BY  TIME  IN  THE  GS-1102  SERIES 


YEARS  EXPERIENCE 

Total 

Number 

Bcspoadcuts 

PtrccBt 

Bachelor 

Degrees 

Percent 

Advanced 

Degrees 

Percent  In 
Top  25% 

Number  of 
Awards  Last 
24  Months 

Overall 

GPA 

Number  of 
Related 
Courses 

Years  of 
Clerical 

ExBtricnce 

0-3Yeara 

1053 

53 

11 

78 

1.6 

3.2 

5.6 

6.1 

4-6  Years 

964 

52 

12 

79 

1.8 

3.2 

5.4 

5.4 

7.9Ycari 

609 

54 

15 

78 

2.0 

3.1 

5.7 

5.5 

10  - 14  Years 

750 

53 

20 

75 

1.8 

3.2 

5.4 

5.8 

15-20Years 

439 

60 

19 

68 

1.8 

3.0 

5.5 

3.6 

21  or  More  Years 

289 

62 

17 

68 

1.8 

2.8 

6.1 

3.4 

AVERAGE 

54 

15 

76 

1.8 

3.1 

5.6 

m 

For  some  unknown  reason,  employees  with  7  to  9 
years  of  experience  received  signiAcantly  more 
awards  that  those  in  other  tenure  groups.  A  more 
important  finding  was  the  large  difference  in  the 
amount  of  experience  in  clerical  positions  between 
employees  having  15  or  more  years  of  experience 
aiul  th(^  having  less.  On  average,  employees 
entering  this  field  in  the  last  15  years  (i.e.,  since 
1976)  had  almost  twice  as  much  clerical  experience 
as  those  entering  before  that  time.  This  finding  is 
important  since,  as  discussed  below,  it  is  not 
uncommon  for  senior  officials  in  procurement  to 
believe  that  the  Government  has  relied  too  much 
diuing  the  last  10  to  15  years  on  the  internal 
placement  of  clerical  personnel  to  fill  entry-level 
GS-1 102  positions. 


Sources  of  Entry  Into  Procurement  Positions  and 
Workforce  Quality 

A  recurring  concern  in  the  supervisors'  written 
comments  was  also  raised  during  our  discussions 
with  senior  management  officials  in  procurement. 
Some  people  in  both  groups  were  disturbed  by  the 
fact  that  most  of  the  employees  who  were  selected 
into  GS-1102  vacancies  during  the  last  10  to  15 
years  entered  this  procurement  series  by  being 
transferred  from  jobs  in  other  series.  These  are 
sometimes  called  inservice  placements,  and 
usually  involve  the  transfer  of  employees  from 
series  with  limited  advancement  potential  into  the 
GS-1102  series.  While  some  supervisors  said  in 
their  comments  that  some  of  their  best  employees 
came  fix>m  inservke  placements,  others  felt  that 
many  of  their  least  productive  employees  became 
contract  specialists  in  this  manner. 
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As  one  supervisor  noted:  "*  *  *  most  new  GS- 
1 102's  are  former  secretaries,  clerks,  or  contract 
assistants  who  have  come  up  through  the  ranks. 
Many  have  little  formal  education  [beyond  high 
school]  and  as  a  result  lack  analytical  thought 
processes  and  are  not  very  iimovative  in  their 
approaches."  Another  supervisor  said  that,  while 
go^  selections  could  resiilt  from  inservice  place¬ 
ment  "*  •  *  the  individuals  who  are  not  as  success¬ 
ful  have  a  difficult  time  getting  out  of  a  clerical 
mode,"  by  which  he  meant  they  were  "lacking  [in] 
the  initiative  and  drive  needed  to  execute  and 
administer  contracts  with  minimum  supervision." 
This  supervisoi^s  point  was  that  while  inservice 
placements  could  be  a  valuable  source  for  filling 
GS-1 102  vacancies,  a  large  number  of  poor  selec¬ 
tions  were  also  made  horn  this  source. 

Before  1981,  many  employees  were  selected  for 
professional  and  administrative  positions  on  the 
basis  of  their  performance  on  one  of  th'^ 
Government's  general  tests  of  ability After 
1981,  the  Government  abandcnp  1  the  use  of  the 
centralized  test  that  had  been  used  for  selecting 
among  applicants  for  professional  and  administra¬ 
tive  fields  such  as  procurement  because  it  was 
alleged  that  the  way  in  which  the  test  scores  were 
used  resulted  in  a  discriminatory  pattern  of 
selections.  After  this  test  was  ab^doned,  agen¬ 
cies  could  request  and  be  given  the  authority  to 
make  their  own  selections  through  use  of  what 
was  termed  the  Schedule  B  hiring  authority. 
However,  agencies  were  supposed  to  use  the 
Schedule  B  authority  on  cin  interim  basis  and  only 
if  they  had  exhaust^  their  ability  to  fill  vacancies 
from  the  inservice  placement  of  employees  from 
other  series.  Inservice  placements  had  been  used 
by  agencies  even  before  the  development  of  the 
Sdiedule  B  authority  to  provide  upward  mobility 
opportunities  to  people,  frequently  from  clerical 
positions,  who  were  believed  to  have  the  potential 
to  work  in  higher  level  jobs. 


Some  agencies  also  developed  what  are  often 
called  intern  programs  to  ^ect  and  develop 
entry-level  personnel  in  procurement  as  well  as 
some  other  professional  and  administrative  frelds. 
Generally,  diese  programs  involved  extensive 
competition  and  fairly  rigorous  selection  criteria. 
Still  other  people  found  their  way  into  GS-1 102 
procurement  positions  through  avenues  such  as 
the  Co-op  and  Work  Study  Programs.  These  were 
programs  which  were  designed  to  allow  college 
and  high  school  students,  respectively,  to  work 
part-time  for  the  Federal  Government  while  at  the 
same  time  attending  school. 

Because  of  concerns  about  the  possible 
consequences  of  having  a  high  proportion  of  the 
new  entrants  to  the  GS-1 102  series  being  selected 
using  inservice  placement  procedures,  we  decided 
to  look  into  whether  there  was  a  meaningful 
difference  in  performance  based  upon  how  a 
person  enter^  the  contract  specialist  series. 
Although  our  survey  for  employees  did  not 
directly  ask  contract  specialists  whether  they  had 
entered  this  field  through  inservice  placement,  we 
did  ask  them  whether  they  had  entered  the  GS- 
1102  series  through  the  other  entry  procedures 
that  were  discussed  above.  Possible  response 
categories  included  the  Co-op  Program,  the  Work 
Study  Program,  an  internship  program,  the 
Schedule  B  hiring  authority,  or  performance  on  a 
written  test.  Employees  could  also  choose  an 
answer  of  "another  sj>ecial  program,"  "no  special 
program,"  or  "don't  know."  Since  we  did  not 
provide  a  separate  category  to  identify  employees 
who  entered  the  GS-1 102  series  through  inservice 
placements,  we  expected  that  most  of  the  employ¬ 
ees  who  came  in  through  this  method  would 
respwnd  to  the  survey  by  selecting  either  the 
"other  special  program"  or  the  "no  special  pro¬ 
gram"  response. 


“  For  additional  in/onnation  on  this  topic  see  U.S.  Merit  Systems  FYotection  Board,  "In  Search  of  Merit  Hiring  Entry-Level  FMeral 
Employees,"  September  1987. 
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Table  12  shows  the  number  of  contract  specialists 
who  said  that  they  had  entered  the  GS-1102  series 
through  each  source  of  entry  and  the  average 
years  of  clerical  experience  for  workers  entering  by 
these  sources.  Although  the  "other  special  pro¬ 
gram"  and  "no  special  program"  categories  were 
not  necessarily  limited  to  persons  who  had  en¬ 
tered  through  inservke  pl^ement,  it  is  clear  that 
most  of  the  people  choosing  either  of  these  re¬ 
sponses  had  extensive  clerical  experience.  In  fact, 
employees  choosing  either  of  these  two  response 
categories  typically  had  significantly  more  experi¬ 
ence  in  clerical  positions  than  persons  who  said 
that  they  had  entered  the  GS-1102  series  in  other 
ways.  Additionally,  persons  selecting  one  of  these 
two  responses  were  much  more  likely  to  have 
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longer  Federal  service  in  series  other  than  the 
GS-1102  than  people  who  had  entered  the 
contract  specialist  field  through  other  routes. 
Although  these  results  do  not  ensure  that  all  of 
the  respoirdents  who  said  that  they  had  become 
contract  specialists  through  either  "no  special 
program"  or  "other  special  program"  were  in 
fact  inservice  placements,  the  pattern  is  quite 
consistent  wifo  what  would  be  expected  for 
people  who  had  entered  the  GS-1102  series  from 
this  source. 

We  used  statistical  procedures  to  test  for  differ¬ 
ences  among  the  sources  of  entry  in  terms  of  the 
various  self  and  supervisory  ratings  of  perfor¬ 
mance  that  were  discussed  earlier  in  this  section. 
Results  of  these  analyses  are  shown  in  table  13. 
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Number  of  Respondents  by  Source  of  Entry  Into  the  GS-1102  Series  and 

Average  Years  of  Qerical  Experience 

Entry  Source 

Number  of 

Average  Years 

Respondents 

qerical  Experience 

Intern  program 

362 

Z1 

Written  tests 

707 

3.2 

Co-op  Program 

98 

Z8 

Schedules 

211 

3.3 

Work  Study  Program 

38 

4.7 

Other  special  program 

371 

6.1 

No  spe^  program 

2,035 

7.0 
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TABLE  13 


AVERAGE  PERFORMANCE  RATINGS  AND  SOURCE  OF  ENTRY  INTO  THE  GS'1102  SERIES 


Supervisory 

Rating 

SOURCE  (AbiUties) 

Supervisory 

Rating 

(Tasks) 

Annual 

Performance 

Rating 

Research 

Rating 

Self 

Rating 

(Abilities) 

Self 

Rating 

(Tasks) 

Intern  Program 

3.19 

3.76 

4.11 

3.88 

3.37 

3.98 

PACE/FSEE 

3.22 

3.85 

4.14 

3.90 

3.38 

3.99 

Cooperative  Program 

3.16 

3.69 

4.06 

3.88 

3.36 

3.89 

Schedule  B 

3.14 

3.68 

4.10 

3.76 

3.32 

3.86 

Work  Study 

Z96 

3.35 

4.16 

3.58 

3.10 

3.70 

Other  Special  Program 

3.09 

3.60 

4.03 

3.75 

3.26 

3.76 

No  Special  Program 

3.08 

3.65 

4.09 

3.81 

3.27 

3.80 

AVERAGE 

3.12 

3.69 

4.10 

3.82 

3.30 

3.85 

As  table  13  illustrates,  based  upon  the  entry  source 
alternatives  that  we  provided,  there  was  a 
consistent  [)attem  of  statistically  significant  difi^- 
ences  in  performance  ratings  among  the  different 
sources  of  entry  (i.e.,  differences  in  average  ratings 
which  have  been  statistically  determined  to  most 
likely  reflect  real  differences  in  perfomumce 
among  the  various  groups) .  Although  the  differ¬ 
ences  in  average  scores  among  the  groups  were 
not  large,  further  tests  showed  that  employees 
who  h^  entered  the  GS-1102  series  through  either 
an  intern  program  or  a  written  test  consistently 
received  the  highest  perfoiinance  ratings.  This 
was  true  regardless  of  whether  the  ratings  were 


provided  by  the  employees'  supervisors  or  the 
employees  themselves.  Employees  who  had 
become  contract  specialists  via  either  Schedule  B 
procedures  or  the  Co-op  Program  teixled  to 
receive  performance  ratings  that  were  lower  than 
those  for  employees  coming  from  an  intern 
program  or  written  tests  but  higher  than  those  for 
employees  entering  from  the  remaining  sources. 

This  same  general  pattern  of  rating  among  the 
source  of  entry  groups  was  also  found  in  terms  of 
the  extent  to  wl^h  supervisors  indicated  that 
their  subordinates  needed  additional  training  in 
the  area  of  analytical  capabilities  as  well  as  in  the 
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ability  to  write,  innovate,  and  conduct  negotia¬ 
tions.  With  regard  to  each  of  these  abilities, 
persons  entering  the  GS-l  102  ranks  from  either  an 
intern  program  or  a  written  test  were  significantly 
less  likely  to  be  seen  as  needing  additional  train¬ 
ing.  No  difference  in  terms  of  the  need  for  train¬ 
ing  in  these  areas  was  foimd  among  people 
entering  the  procurement  workforce  from  the 
other  possible  sources.  Additionally,  it  should  be 
noted  that  the  only  performance  variable  for 
which  there  were  no  significant  differences  among 
groups  based  upon  source  of  entry  was  the 
employee's  official  performance  appraisal  rating. 

As  mentioned  earlier,  although  the  differences  in 
both  self  and  supervisory  performance  ratings 
among  entry  groups  were  statistically  significant, 
the  size  of  the  differences  in  the  various  assess¬ 
ments  of  performance  were  not  very  large.  There 
were,  however,  a  number  of  factors  which  prob¬ 
ably  work  against  finding  large  differeiKes  in  the 
average  performance  ratings  among  the  groups. 


For  example,  the  identification  of  employees  into 
entry  groups  is  far  from  perfect.  Many  employees 
may  not  rerrwmber  how  they  entered  the  GS-l  102 
series.  It  is  not  unlikely  that  some  of  those  who 
entered  through  one  of  the  special  programs  but 
did  not  remember  doing  so  would  have  re¬ 
sponded  in  either  the  "no  special  program"  or 
"other  special  program"  categories.  To  the  extent 
this  occurred,  it  would  tend  to  reduce  the  differ¬ 
ences  between  respondents  in  these  categories  and 
respondents  from  other  sources  of  entry.  In 
ad^tion,  there  was  a  tendency  towards  high  self 
and  supervisory  ratings  for  a  very  large  portion  of 
the  contract  sp)ecialist  workforce.  The  fact  that  so 
many  employees  received  high  self  and  supervi¬ 
sory  ratings  tends  to  blur  distinctions  in  actual 
performance  among  individual  workers.  This,  in 
turn,  reduces  the  likelihood  of  obtaining  large 
differences  in  mean  performance  ratings  among 
any  separate  groups  within  the  total  population, 
in  this  case  based  on  the  different  ways  in  which  a 
person  could  enter  the  GS-l  102  workforce. 
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Sampling  Client  Views 

As  p)art  of  the  Board's  and  OPM's  research  pro¬ 
grams  on  Federal  workforce  quality,  an  Advisory 
Comiruttee  on  Federal  Workforce  Quality  Assess¬ 
ment  was  established  in  1990.  During  our  meet¬ 
ings  with  members  of  this  group,  they  suggested 
that  valuable  information  about  workforce  quality 
could  be  obtained  from  the  clients  to  whom  goods 
or  services  are  provided.  This  view  was  also  held 
by  some  of  the  senior  procurement  officials  with 
whom  we  held  discussions.  Accordingly,  a  third 
and  fourth  perspective  of  procurement  work 
quality  was  provided  by  f)ersons  who  were,  in  a 
real  sense,  clients  for  the  work  performed  by 
contract  specialists.  One  facet  of  client  satisfaction 
was  provided  through  mformation  collected  from 
a  survey  of  current  members  of  the  Senior  Execu¬ 
tive  Service.  The  intent  of  this  was  to  learn  what 
people  in  charge  of  major  Government  organiza¬ 
tions  thought  of  the  adequacy  of  the  procurement 
services  that  they  receiv^.  An  additional  siuvey 
was  sent  to  private  sector  companies  that  had 
contracts  with  the  Government  and  whose  repre¬ 
sentatives  had  dealings  with  Federal  contract 
specialists.  Persons  responding  to  each  of  these 
surveys  were  asked  about  the  overall  effectiveness 
of  Federal  procurement  practices,  the  quality  of 
products  provided  to  the  Government  by  the 
private  sector,  and  the  quality  of  work  performed 
by  the  individual  Fedei^  contract  specialists  with 
whom  they  dealt. 


Surveys  designed  to  assess  the  extent  of  "client 
satisfaction"  with  the  work  performed  by  contract 
specialists  were  mailed  to  2,790  randomly  selected 
senior  executives,  or  about  40  percent  of  the 
approximately  7,000  members  of  the  SES. 
Completed  survey  forms  were  returned  by  1,412 
individuals,  for  a  return  rate  of  51  percent. 

Since  only  responses  of  individuals  who  were 
knowledgeable  about  the  work  of  contract  special¬ 
ists  were  relevant  to  this  study,  SES  members 
were  asked  to  tell  us  if  their  organization  relied  on 
the  work  of  contract  specialists  and  if  they  were 
able  to  evaluate  the  quality  of  the  work  performed 
by  the  contract  specialists  supporting  their  organi¬ 
zation.  If  neither  of  these  conditions  was  met,  the 
responses  for  these  executives  were  eliminated 
from  further  consideratioa  After  discarding  the 
responses  from  senior  executives  who  met  neither 
of  these  criteria,  we  were  left  with  valid  responses 
from  918  SES  members. 

These  918  senior  executives  reported  that  they 
were  quite  knowledgeable  about  procurement 
actions  in  their  organization.  This  was  especially 
true  in  connection  with  contracts  having  a  value 
over  $25,000,  about  which  82  percent  said  that 
they  knew  a  great  deal  The  extent  to  which  these 
SES  members  were  knowledgeable  about  Federal 
procurement  was  also  indicated  by  the  fact  that 
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almost  99  percent  said  that  they  were  at  least 
"somewhat  familiar"  with  the  Government 
contracting  process  (with  68  percent  indicating 
that  they  were  "very  femiliar"  with  at  least  some 
aspects  of  the  contracting  process). 

A  second  group  of  clients  for  the  work  performed 
by  contract  specialists  was  the  private  sector  firms 
that  provide  contracted  goods  or  services  to  the 
Government.  These  organizations  frequently 
depend  upon  the  Government  for  a  laige  portion 
of  their  business  and,  for  this  reason,  are  often 
quite  familiar  with  the  Federal  procurement 
process  and  the  work  of  contract  specialists.  A 
comprehensive  list  of  businesses  contracting  with 
the  Government  is  contained  in  the  Federal 
Procurement  Data  Hie  maintained  by  the  General 
Services  Administration.  We  selected  a  random 
sample  of  900  contracts  awarded  within  the  last 
year  from  this  file.  The  sample  was  drawn  to 
represent  contracts  of  all  types,  from  purchases  of 
office  equipment  to  contracts  written  for  the 
procurement  of  major  weapons  systems.  We 
developed  a  questionnaire  with  the  assistance  of 
procurement  subject  matter  experts  and  distri¬ 
buted  it  to  the  business  respoiAsible  for  each 
contract. 

Completed  surveys  were  returned  from  373 
conti^ors,  for  a  return  rate  of  about  41  percent. 
While  this  return  rate  is  not  unusual  for  surveys  of 
the  private  sector,  it  is  possible  that  the  informa¬ 
tion  that  we  obtained  may  not  be  representative  of 
the  entire  population  of  (Government  contractors. 
However,  it  should  be  noted  that  a  number  of 
businesses  called  or  wrote  back  to  us  and  said  that 
the  reason  they  did  not  complete  the  survey  was 
because  they  were  unable  to  identify  a  person 
currently  employed  by  them  who  had  sufficient 
knowledge  about  the  contract  in  question  to 
respond  to  oiu*  survey.  Thus  our  final  sample, 
although  relatively  small,  may  be  representative  of 
those  businesses  most  knowledgeable  about 
Federal  procurement  It  should  be  noted,  how¬ 


ever,  that  because  of  the  nature  of  our  sample, 
surveys  were  only  distributed  to  businesses  which 
had  been  awarded  the  particular  contract  selected 
for  inclusion  in  our  sample.  It  is,  therefore,  pos¬ 
sible  that  the  losing  businesses  would  have  had  a 
somewhat  different  view  than  the  contractors  who 
won  the  contract 

The  Quality  of  Solicitations 

When  private  contractors  leam  that  a  Government 
agency  is  interested  in  contracting  for  particular 
goods  or  services,  they  normally  find  out  the 
details  of  the  contract  by  requesting  copies  of  a 
formal  solicitation  from  the  agency's  contract 
specialists.  Solicitations  are  prepared  by  contract 
specialists  and  sent  to  businesses  expressing 
interest  in  contracting  with  the  Government. 
Generally,  potential  contractors  will  have  to 
respoivd  to  the  solicitation  with  a  bid  or  proposal 
by  a  specified  date.  Therefore,  it  is  important  that 
the  solicitation  reach  vendors  quickly  so  that  they 
can  respond  in  a  timely  manner.  The  vast  major¬ 
ity  of  the  vendors  (93  percent)  said  that  the  solici¬ 
tation  for  the  contract  that  they  were  awarded  was 
received  in  a  timely  maimer.  Most  (81  percent) 
also  reported  that  the  requirements  laid  out  in  the 
solicitation  were  sufficiently  clear  to  enable  them 
to  understand  what  it  was  that  the  Government 
wanted  to  buy.  Even  so,  comments  provided  by 
several  of  the  contractors  responding  to  our 
survey  indicated  that  they  had  problems  under¬ 
standing  the  Government's  solicitation.  As  one 
respondent  to  the  survey  said; 

rrjhe  Cfovemment  has  in  most  cases  put 
out  a  very  poor  solicitation,  full  of  errors 
and  then  left  it  to  the  contractors  to  find 
the  errors  and  try  to  correct  [them]  *  *  *. 

The  errors  include  incorrect  technical 
data  listings,  incorrect  specifications, 
lack  of  technical  data  and  drawings,  and 
incorrect  clauses  from  the  FAR  [Federal 
Aocjuisition  Regulations]. 
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In  order  to  be  considered  as  a  potential  source  for  ship  between  their  conipany  and  the  contracting 

the  required  goods  or  services,  businesses  typi-  representative  was  one  which  has  facilitated  the 

cally  must  submit  infonnation  to  demonstrate  that  delivery  of  quality  products  to  the  Government, 
they  are  qualified  to  fulfill  the  terms  of  the  Similarly,  76  percent  said  that  their  business  had  a 

contract.  A  description  of  what  they  are  required  good  working  relationship  with  the  contracting 

to  submit  is  also  contained  in  the  solicitation.  representative. 

According  to  the  respondents  to  this  survey,  most 

(71  percent)  were  able  to  imderstand  from  the  Despite  the  existence  of  a  good  working  relation- 
solicitation  what  they  were  required  to  submit  A  ship  with  the  contracting  representative,  it  is 
significant  minority,  however,  indicated  that  they  possible  that  there  will  be  disputes  concerning  the 
did  not  imderstaivl  the  requirements  or  needed  delivery  of  services  or  products  imder  the  terms  of 
additional  clarification  on  this  issue.  Moreimpor-  the  contract  Although  95  percent  of  the  vendors 

tantly,  in  spite  of  the  fact  that  most  vendors  said  said  that  they  were  performing  the  services  or 

that  they  were  able  to  imderstand  what  they  were  delivering  the  products  that  they  expected  to  on 
required  to  submit,  41  percent  said  that  they  the  basis  of  the  solicitation,  and  99  percent  Scdd 

formally  requested  daiification  on  some  portion  of  that  their  products  were  of  at  least  acceptable 
the  solicitation.  Moreover,  only  77  percent  of  the  quality,  more  than  one-third  reported  that  there 
vendors  who  formally  requested  clarification  felt  had  been  disputes  about  their  performance  under 

that  their  questions  were  fully  answered.  This  is  a  the  terms  of  the  contract.  In  more  than  half  of 

particularly  significant  finding  in  light  of  the  fact  those  instances,  the  disputes  involved  the  nature 
that  these  responses  came  from  the  businesses  of  the  goods  or  services  to  be  provided  tmder  the 
that  ended  up  getting  the  contract.  It  is  therefore  terms  of  the  contract.  Although  in  some  cases  this 
probable  that  an  even  higher  percentage  of  the  was  certainly  the  result  of  poor  performance  on 
businesses  that  lost  the  competition  for  the  the  part  of  the  contractor,  it  is  also  possible  that 

contract  had  problems  undersUmding  exactly  some  of  the  problems  were  the  result  of  a  lack  of 

what  it  was  the  Government  wanted  them  to  clarity  on  the  part  of  the  Government  which  led  to 

submit.  the  contractor's  incomplete  imderstanding  as  to 

what  was  expected. 

Frequently,  when  the  work  provided  by  the 

contractor  is  technical  in  nature,  an  employee  well-  Rgure  3  shows  how  private  verxlors  thought  the 
versed  in  the  subject  will  be  appointed  by  the  disputes  were  resolved.  While  the  most  common 

Government  organization  as  a  contracting  officer's  response  on  the  part  of  the  vendors  was  that  the 
technical  representative.  It  is  this  person's  respon-  dispute  was  resolved  professionally  and  fairly, 
sibility  to  work  with  the  agency  contract  speci^ts  about  a  quarter  of  the  contractors  believed  that  the 
and  the  vendor  to  ensure  that  the  Government  is  dispute  was  resolved  arbitrarily.  Although 
receiving  the  goods  or  services  that  it  needs.  disgruntlement  arising  from  losing  the  dispute 

According  to  the  vendors,  a  Government  may  account  for  some  of  this  finding,  the  fact  that 

contracting  representative  was  appointed  for  73  26  percent  believed  that  the  dispute  was  not 

percent  of  the  contracts.  Of  those  expressing  an  resolved  fairly  also  suggests  that  communication 
opinion,  93  percent  said  that  the  working  relation-  and  understanding  between  contractors  and 

Government  representatives  could  be  improved. 


A  Rqxfrt  by  the  IT.S.  Merit  Systems  Protection  Board 


33 


Qualify  in  Pfocurement:  'Views  of  Qienfs 


FIGURE  3.  HOW  CONTRACTORS  BELIEVE 

DISPUTES  ARE  SEHLED 


50 


ProfeMlpnaily  Arbitrarily  DItputa  Not  Don't  Know 
and  Fairly  by  Contract  Yet  Resolved 
Officer 


Client  Views  of  Procurement 
Workforce  Quality 

In  the  course  of  planning  this  study  we  conducted 
numerous  discussions  with  Feder^  personnel  in 
the  procurement  field.  Ouring  these  discussions 
many  of  the  procurement  authorities  expressed 
concern  that  we  intended  to  assess  the  attitudes  of 
senior  management  officials  towards  the  procure¬ 
ment  function.  They  felt  that  there  was  a  natural 
tension  between  people  in  management  and 
people  working  in  procurement  that  could  affect 
the  managers'  evaluations  of  procurement 
personnel 


Contrary  to  the  expectations  of  procurement 
officials,  in  many  ways  the  senior  executives 
responding  to  our  survey  thought  quite  highly  of 
the  contract  specialists  who  support  their  organi¬ 
zations  and,  as  shown  in  table  14,  they  viewed 
several  aspects  of  the  work  performed  by  contract 
specialists  quite  positively.  In  particular,  SES 
members  thought  that  contract  specialists  who 
^pport  their  organization  are  knowledgeable  and 
apply  regulations  fairly  and  accurately.  Perhaps 
not  surprisingly,  given  the  fact  that  they  were 
responsible  for  activities  in  their  organization. 


i 
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91  percent  of  the  senior  executives  said  that 
contracts  are  awarded  fairly  and  appropriately. 
Additionally,  86  percent  reported  that  die  efforts 
of  contract  specialists  supporting  their  organiza¬ 
tion  resulted  in  contracts  that  are  always  legal  and 
defensible.  There  was  also  general  agreement  (Le., 
90  percent  expressing  agreement)  that  the  quality 
of  the  work  performed  by  these  same  contract 
specialists  at  least  meets  acceptable  staiKlards. 
Given  all  of  the  above  results,  it  is  not  surprising 
that  72  percent  of  the  respoiulents  said  that 
contract  specialists  often  make  substantial 
contributions  to  their  organizations. 


Although  senior  executives  were  generally  posi¬ 
tive  concerning  many  aspects  of  the  work  f)er- 
formed  by  contract  specialists,  in  several  areas 
they  said  there  is  room  for  improvement.  For 
example,  senior  executives  were  somewhat  less 
satished  about  the  extent  to  which  people  working 
in  procurement  maintain  a  positive  service  orien¬ 
tation  towards  clients  or  colleagues  in  their  organi¬ 
zation.  In  response  to  this  item,  only  60  percent 
said  that  contract  specialists  usually  maintain  a 
helpful  attitude  when  dealing  with  representatives 
of  ibe  organizations  that  they  support.  It  may 


Table  14 


SES  and  Contractor  Opinions  Concerning  GS-llOZ  Employees 
(Percent  of  SES  Members  and  Contractors  Responding  to  the  Question  "Federal  contract  specialists 


Item 

(are):") 

SES  Memb»s 

AsCfifi  Disagree 

Contractors 

Agree  Disagree 

Knowledgeable  about 

Federal  procurement 
procedures. 

90 

4 

68 

15 

Apply  Government 
regulations  accurately 
and  fairly. 

79 

8 

58 

20 

Well  trained. 

74 

13 

63 

24 

Generally  helpfuL 

74 

14 

66 

16 

Provide  prompt  responses 
to  questions. 

62 

21 

56 

29 

Notes:  1.  The  cxjlumn  labelled  "Agree"  includes  both  "Strongly  Agree"  and  'Tend  to  Agree"  responses.  Similarly,  the 
"Disagree"  column  includes  both  "Strongly  Disagree"  and  'Tend  to  Disagree"  responses.  2.  "Neither  Agree  nor  Disagree" 
and  "Don't  Know"  responses  were  omitted. 
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a]so  be  significant  that  a  sizable  minority  (24  While  the  timeliness  of  procurement  actions  was 

percent)  of  SES  members  expressed  coiKems  that  an  important  coiKem  to  many  senior  executives, 

the  work  output  of  contract  specialists  who  the  conunents  that  they  provided  in  connection 

support  their  orgaiuzation  is  low  aixl  that  work  is  with  the  survey  revealed  that  some  SES  members 

performed  at  a  slower  than  acceptable  rate.  had  other  significant  coiKems  about  procurement 

in  their  orgairizations.  A  number  of  seiuor  execu- 

Similarly,  as  figure  4  shows,  38  percent  of  the  fives  provided  comments  such  as:  "Much  of  the 

senior  executives  said  that  with  the  possible  restricted  productivity  I  have  witnessed  seems  to 

exception  of  some  routine  tasks,  work  by  contract  be  due  to  excessive  layers  of  regulations  that  keep 

specialists  supporting  their  organization  was  getting  added."  In  the  eyes  of  one  senior  manager 

usually  not  complete  in  a  timely  manner.  this  has  n\ade  things  so  complicated  that: 


FIGURE  4.  SES  VIEWS  OF  TIMELINESS  OF 
PROCUREMENT  ACTIONS 

To  what  extent  Is  work  done  by  Contract  Specialists 
for  your  organizations  performed  In  a  timely  manner? 


Except  for  routine  work, 
aMlgnmentt  are  usually 
not  completed  on  time 


Work  It  usually  completed 
In  a  timely  manner 


Work  Is  frequently 
completed  ahead 
of  schedule 


•  II  21 
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Only  the  brightest  and  most  courageous 
are  able  to  work  effectively.  The  rest 
work  as  if  they  believe  that  their  pri¬ 
mary  job  is  to  avoid  trouble  and 
controversy  ••• .  The  risk  of  doing 
something  improper  or  illegal  has 
inflicted  the  Govenunent  with  a  kind  of 
self-administered  paralysis. 

As  was  the  case  for  supervisors,  a  very  common 
theme  in  the  comments  provided  by  members  of 
the  SES  was  that  they  thought  that  too  many 
contract  specialists  were  "rule-bouiKi"  and  prone 
to  attempt  to  apply  rules  blindly  to  a  variety  of 
contracting  situations  without  adequately  under¬ 
stand  .  the  objectives,  goals,  or  mission  of  the 


organization.  These  same  senior  executives  saw 
contract  specialists  as  myopic  defenders  of 
contract  regulations  rather  than  as  team  players 
whose  purpose  is  to  get  the  job  done  effectively. 
As  such,  contract  specialists  were  seen  to  be  more 
inclined  to  follow  a  procurement  cookbook  than 
to  look  for  iimovative  and  legal  solutions  to 
orgaiuzational  needs. 

This  perception  on  the  part  of  some  SES  members 
was  also  reflected  in  their  response  to  a  question 
about  the  creativity  of  the  work  performed  by 
contract  specialists.  As  figure  5  illustrates,  39 
percent  of  the  senior  executive  respondents  said 
that  the  contract  specialists  supporting  their 
organization  show  inadequate  creativity  in  their 
work. 


FIOURE  6.  SES  VIEWS  OF  GS-1102  EMPLOYEES 

How  much  croatMty  It  thown  In  the  work 
done  by  Contract  Speclalittt  In  your  organization? 


Limited  or  no  creativity 


Moderate  creativity 


Much  or  exceptional  creativity 
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This  concern  with  the  lack  of  creativity  also  was 
exhibited  in  the  responses  of  SES  members  to  a 
question  concerning  the  skills  which  they  believed 
are  lacking  in  experieiKed  contract  specialists  in 
their  organizations.  Table  15  shows  the  five  skills 
senior  executives  most  commonly  believed  are 
lacking  in  experienced  contract  specialists. 

It  is  worth  noting  that  fuU-perfonnance-level 
contract  specialists  were  more  likely  to  be  seen  as 
lacking  creativity  and  ingenuity  th^  were  entry- 
level  personnel  They  were  also  more  likely  to  be 
seen  as  lacking  initiative.  It  also  appears  that 
senior  executives  felt  that  some  contract  specialists 
do  not  work  well  with  other  members  of  their 
organization.  According  to  our  SES  respondents, 
significant  portions  of  the  contract  specialist 
workforce  lack  both  group  interaction  and  cross- 
disdplinary  skills.  This  last  finding  may  account 
for  the  results  discussed  earliei;;  i.e.,  that  many 
contract  specialists  were  seen  as  lacking  a  positive 
service  orientation. 


Although  critical  of  their  contract  specialists  in 
some  ways,  senior  executives  recognized  that 
some  of  ^e  concerns  they  raised  may  have  re¬ 
sulted  fi*om  the  coiKlitions  under  wl^h  contract 
specialists  frequently  must  work.  For  example,  58 
percent  of  the  SES  members  said  that  contract 
specialists  who  support  their  organization  are  too 
often  asked  to  perform  difficult  tasks  imder  tight 
time  constraints  (only  20  percent  disagreed). 
Additionally,  most  (51  percent)  indicated  that 
contract  specialists  are  often  imder  undue  pres¬ 
sure  as  a  result  of  having  too  much  work  to 
perform.  By  contrast,  only  25  percent  felt  that  this 
is  not  the  case. 

As  can  also  be  seen  from  table  14,  private 
contractors  held  a  generally  positive  view  of 
Federal  contract  specialists  in  at  least  several  areas. 
Like  the  senior  executives,  contractors  felt  that 
Federal  contract  specialists  were  basically  knowl¬ 
edgeable,  well-trained,  and  helpful.  Even  so,  they 
tended  to  be  somewhat  less  positive  than  were  the 
senior  executives  with  respect  to  the  same  items. 


Table  15 

Percent  of  SES  Members  Believing  that  Full-Performance-Level  GS-llOZ  Employees 

Lack  Five  Key  Skills 

Skill  Aim 

Percent  of  SES  Members 

Creativity  and  Ingenuity 

43 

Cross-Disciplinary  Skills 

28 

Initiative 

27 

Management  Skills 

23 

Croup  Intoaction  Soils 

22 
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Responses  to  other  items  on  the  survey  revealed 
that  there  were  some  areas  of  concern  among 
private  contractors.  Although  85  percent  of  the 
contractors  said  that  their  firm  has  a  good  working 
relationship  with  the  contract  specialist  assigned 
to  their  contract,  almost  one-thiid  of  these  same 
private  sector  respondents  did  not  think  that 
contract  specialists  are  prepared  to  discuss  sub¬ 
stantive  issues  concerning  the  contract  Additiorv 
ally,  almost  one-third  did  not  believe  that  contract 
specialists  provide  prompt  responses  to  their 
(questions.  According  to  one  respondent 

All  Government  staff  we  have  dealt 
with  have  been  courteous  and  helpful, 
but  it  has  been  ahnost  impossible  to  get 
any  kind  of  decision  on  a  problem  in  a 
timely  manner.  Even  simple  technical 
or  fiiiancial  problems  require  three  or 
four  levels  of  referral  which  results  in 
months  (and  oocasioiudly  years)  of 
delay. 

While  the  first  priority  of  contract  sp)ecialists 
should  be  meeting  the  needs  of  their  oiganization 
in  a  cost-effective  and  legal  manner,  it  is  also 
important  that  they  be  able  to  work  well  with  the 
private  businesses  with  whom  they  deal.  There 
are,  however,  sonne  indications  that  Federal 
contract  specialists  do  not  always  have  a  good 
working  relationship  with  private  contractors. 
Although  arguably  not  their  main  responsibility, 
more  tl^  a  third  of  the  contractors  reported  that 
contract  specialists  are  not  particularly  concerned 
with  the  l^t  interests  of  the  contractor's 
company.  Additionally,  written  comments 
proved  by  the  contractors  suggested  that  from 
their  perspective  contract  specialists  are  not 
always  easy  to  work  with.  In  the  words  of  one 
respondent,  "There  is  very  much  of  an  'us  versus 
them'  mentality  among  Government  negotiators. 
Many  seem  to  view  the  contractor  as  a  crook  who 
is  not  to  be  trusted."  According  to  another 
vendor,  "Government  employees  fail  to  respect 


those  employees  in  the  private  sector  as  fellow 
professioirals.  *  *  *  On  several  occasions.  Govern¬ 
ment  employees  have  been  rude  to  the  point  of 
embarrassment" 

Although  the  relationship  between  contract 
specialists  and  their  counterparts  in  the  private 
sector  is  important,  of  perhaps  even  greater 
concern  is  fire  fact  that  20  p)ercent  of  the  respon¬ 
dents  did  not  feel  that  contract  specialists  apply 
regulations  accurately  and  fairly.  Moreover,  given 
that  all  the  respondents  to  this  survey  were 
companies  who  were  winners  in  the  contracting 
process,  it  is  particularly  noteworthy  that  only  68 
percent  of  the  private  contractors  said  that  based 
upon  their  own  experience,  contract  awards  are 
determined  fairly  and  appropriately.  This  may  be 
related  to  the  fact  that  even  these  successful 
contractors  may  have  lost  contracts  in  the  past 
even  though  they  felt  they  made  the  Government 
very  competitive  offers. 

Client  Views  of  Federal 
Procurement  Process 


The  continuing  changes  to  the  Federal 
Acquisition  Emulations  mcike  it  virtually 
impossible  to  stay  abreast  of  the 
requirements.  Increased  oversight  has 
became  cumbersome,  delayed  the  process, 
and  has  created  an  atmosphere  of  fear  and 
distrust.  This  has  greatly  impacted  the 
decisionmaking  process  and  has  increased 
overall  costs  to  both  the  Government  and  the 
contractor. 

— A  private  contractor 


In  addition  to  questions  about  the  individuals 
with  whom  they  deal,  we  asked  both  the 
contractors  and  the  senior  executives  a  series  of 
questions  concerning  the  Federal  procurement 
process.  Generally,  the  views  of  private  contractors 
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concerning  the  Federal  procurement  process  were 
very  similar  to  those  held  by  the  SES  members. 

As  table  16  shows,  both  groups  had  very  little 
positive  to  say  about  the  procurement  process. 
Among  both  groups  there  was  a  genei^ 
consensus  that  the  Federal  procurement  process 
does  not  effectively  reduce  waste,  fraud,  or  abuse, 
and  does  not  serve  the  best  interest  of  either  the 
Government  or  private  contractors. 

Both  the  contractors  and  the  senior  executives 
were  negative  about  the  procurement  process  in 
several  additional  ways.  For  example,  63  percent 
of  the  contractors  felt  that  the  contracting  process 
is  too  time  consuming,  and  58  percent  said  that 
the  process  for  awarding  contracts  is  too 


cumbersome.  Similarly,  the  vast  majority  of  SES 
respondents  said  that  ^e  Federal  procurement 
process  takes  too  long  (91  f)ercent)  and  involves 
too  much  "red  tape"  (89  percent).  As  a  result, 
more  often  than  not,  members  of  both  groups 
reported  that  the  procurement  process  is  ineffec¬ 
tive  in  meeting  either  the  needs  of  the  Govern¬ 
ment  or  private  sector  contractors. 

Once  again,  written  comments — this  time  those 
provided  by  SES  respondents — Whelped  to  explain 
these  findings.  According  to  these  senior  execu¬ 
tives,  the  main  problem  loith  the  Federal  procurement 
system  is  that  it  has  become  far  too  complicated.  In  the 
view  of  many  senior  executives  this  has  had  a 
detrimental  effect  on  procurement  in  their  organi¬ 
zations  in  at  least  two  ways. 


TABLE  16 


SES  and  Contractor  Opinions  of  the  Federal  Procurement  Process 

(Percent  of  SES  Members  and  Contractors  Responding  to  Uie  Question 
'The  Federal  Procurement  Process":) 


SES  Members 

Contractors 

Item 

Agree 

Disagree 

Agree 

Disagree 

Effectively  reduces  the 
incidence  of  waste,  fiaud. 

and  abuse 

39 

40 

29 

39 

Serves  the  best  interests 
of  the  Government. 

34 

47 

42 

36 

Serves  the  best  interests 
of  private  sector 
contractors. 

25 

45 

11 

65 

Notes:  1.  The  colums  labeled  "Agree"  mclude  both  "Strongly  Agree"  and  'Tend  to  Agree"  responses. 
Similarly,  the  "EHsagree"  columns  include  both  'Strongly  Di^gree"  and  'Tend  to  Disagree"  responses.  2. 
"Neither  Agree  nor  Disagree"  and  "Don't  Know"  responses  were  omitted. 
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Rrst,  the  increase  in  paperwork  associated  with 
most  procurement  actions  has  greatly  increased 
the  workload  for  most  contract  specialists.  This 
has  added  considerably  to  the  pressure  felt  by 
many  contract  specialists  and  has  made  it  more 
difficult  for  them  to  meet  important  organizational 
deadlines.  As  a  result,  the  relationship  between 
contract  specialists  and  their  dients  is  often 
strained  and  contract  specialists  may  be  pressured 
to  bend  or  even  break  the  rules  in  order  to 
complete  a  procurement  action  in  a  more  timely 
maimer. 

Second,  senior  executives  indicated  that  in  many 
cases  the  complexity  of  the  system  has  simply 
exceeded  the  capabilities  of  the  contract  specialists 
who  support  their  organizations.  In  their  view,  all 
too  frequently,  contract  specialists  may  not  imder- 
stand  either  the  options  that  are  available  to  them 
or  all  the  regulatory  requirements  that  govern 
procurement  actions.  This  lack  of  understanding 
of  options  may  be  what  supervisors  and  senior 
executives  were  referring  to  when  they  said  that 
too  many  contract  specialists  lack  creativity.  Asa 
result,  procurement  actions  may  be  delay^,  and 
when  finally  completed,  may  not  represent  the 
best  or  most  cost-effective  approaches  to  meeting 
the  needs  of  their  organization. 

Many  senior  executives  thought  that  this  leaves 
the  Government  with  only  two  alternatives.  In  the 
words  of  one  respondent,  either  "The  entire 
procurement  system  needs  to  be  simplified  and 
made  more  eftoent"  or  "the  quality  of  the  people 
operating  the  system  has  to  improve." 

A  review  of  the  comments  included  by  the  private 
contractors  responding  to  our  survey  revealed 
several  additional  recurring  themes.  For  example, 
contractors — 

□  Have  a  general  lack  of  uruierstanding  and 
acceptance  of  the  process  for  determining 
contract  awards; 


□  View  the  procurement  process  as  overly 
bureaucratic  and  slow;  and 

□  Feel  that  contract  specialists  are  not  ad¬ 
equately  prepared  to  work  effectively  in  an 
increasingly  complex  procurement  environ¬ 
ment. 

The  most  difficult  thing  for  businesses  to  under¬ 
stand  was  the  role  of  the  weighting  of  technical 
merit  versus  cost  in  determining  who  would  win 
the  contract  Many  contractors  thought  that  the 
Government  was  too  concerned  with  getting  the 
lowest  possible  bid,  even  to  the  point  of  accepting 
products  or  services  of  inferior  quality.  As  one 
respondent  put  it 

Requests  for  clarification  on  the  effect  of 
price  in  the  evaluation  are  met  by 
general,  unspecific  responses  which 
often  result  in  sacrificing  quality  to 
achieve  a  low  price  in  order  to  increase 
the  probability  of  winning  the  contract. 

This  occurs  despite  Government  pro¬ 
nouncements  regarding  the  importance 
of  quality. 

An  even  larger  area  of  concern  was  the  bureau¬ 
cratic  nature  of  the  contracting  process.  According 
to  many  of  the  respondents  providing  written 
comments  this  has  gotten  markedly  worse  in 
recent  years.  A  sampling  of  the  comments  from 
private  contractors  addressing  this  issue  includes 
the  following: 

The  Federal  procurement  process  is 
wrought  with  inefficiency  and  nonsensi¬ 
cal  administrative  trappings.  Congress 
has  totally  disrupted  the  procurement 
process  by  their  micro-management  of 
the  details  of  the  process.  They  legislate 
cumbersome  rules  and  regulations 
without  regard  to  the  viability  or  impact 
on  those  of  us  in  the  profession. 
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Typically,  a  contract  from  a  private 
owned  customer  is  1-2  pages  in  length. 

The  contract  from  the  Government  to 
buy  exactly  the  same  thing  is  typically 
30^  pages  in  length. 

According  to  their  comments,  both  SES  respon¬ 
dents  and  private  contractors  believe  that  the 
complexity  involved  in  processing  procurement 
actions  has  greatly  increased  over  the  last  10  years. 
Unfortunately  th^  same  respondents  said  tluit 
the  quality  of  the  Federal  contract  specialists  has 
not  imdergone  a  similar  increase,  ^tead, 
comments  from  both  groups  suggested  that 
contract  specialists  are  themselves  overwhelmed 
by  the  complexity  and  paperwork  associated  with 
procurement  actions.  In  fact,  although  contractors 
often  appreciated  attempts  by  contract  specialists 
to  make  things  flow  smoothly,  many  also  thought 
that  most  contract  specialists  are  not  able  or 
adequately  prepared  to  work  effectively,  given  the 
intricacies  of  the  procurement  process. 


Some  other  respondents  firom  both  groups  were 
even  harsher  concerning  the  capabilities  of  F^- 
eral  contract  specialists.  The  views  of  three 
private  contractors  are  expressed  in  the  following 
quotes: 

If  the  Government  employees  were 
more  interested  in  getting  the  job  done 
equitably  instead  of  covering  Aem- 
selves,  everything  would  be  more 
efficient. 

Most  of  our  jobs  now  are  administered 
by  unqualified  p)ersons. 

Too  many  people  blindly  carry  out 
their  duties  by  strictly  applying  rules 
and  regulations  based  on  very  limited 
experience  and  understanding. 
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Method  for  Demonstrating  the  Utility 
of  Potential  Quality  Indicators 

In  the  introduction  to  this  report,  we  stated  that 
one  of  the  goals  of  MSPB  in  undertaking  this 
study  was  to  identify  easily  measurable  workforce 
factors  that  relate  to  successful  job  performance. 

In  essence,  we  were  hoping  to  identify  valid 
indicators  or  predictors  of  workforce  quality  that 
could  be  used  to  track  changes  in  quality.  These 
indicators  could  be  potentially  useful  to  both 
policymakers  and  future  researchers  who  wish  to 
determine  whether  workforce  quality  has  changed 
over  time  as  a  result  of  policy  initiatives  or  other 
efforts. 

In  undertaking  this  study,  we  identihed  several 
potential  quality  indicators.  IiK;luded  were  items 
which  were  easy  to  assess  and  which  subject- 
nnatter  experts  in  the  area  of  procurement  thought 
might  be  related  to  successful  performance.  The 
measures  used  in  this  study  induded  education 
level,  perfbrmaiKe  in  school,  courses  completed  in 
fields  related  to  procurement,  the  number  of 
Government  sponsored  training  courses 
completed,  the  number  of  awards  received,  and 
work  experience. 

In  order  to  show  that  some  or  all  of  the  factors 
mentioned  above  are  valid  indicators  of  workforce 
quality,  it  is  necessary  to  demonstrate  the  exist¬ 
ence  of  a  statistically  signihcant  relationship 
between  an  individual's  possession  of  these 


attributes  and  assessments  of  the  quality  of  his  or 
her  work.  In  the  course  of  conducting  this  study, 
we  collected  from  both  individual  workers  and 
their  supervisors  the  various  ratings  of  contract 
specialists  work  performance  that  were  discussed 
in  earlier  sections  of  this  report. 

In  addition  to  the  ratings  of  performance  provided 
by  employees  and  their  supervisors,  one  measure 
of  performance  was  included  which  did  not 
depend  directly  on  judgements  of  quality.  This 
was  the  advancement  rate  of  the  employee.  This 
was  defined  as  the  grade  attained  by  each  em¬ 
ployee,  taking  into  account  how  long  he  or  she 
had  been  working  as  a  contract  specialist.  Since 
employees  who  are  most  able  to  perform  the  work 
requir^  of  contract  specialists  should  generally  be 
the  ones  who  advance  the  farthest  in  terms  of 
grade,  the  grade  attained  by  an  employee  should 
reflect  the  quality  of  his  or  her  work  Of  course, 
employees  who  have  been  in  the  GS-1102  series 
for  only  a  relatively  short  period  of  time  will  not 
have  h^  the  opportunity  to  advance  to  levels 
reflecting  the  quality  of  their  work.  For  this 
reason,  we  us^  statistical  analyses  which  permit¬ 
ted  us  to  look  at  the  relationship  between  a 
person's  grade  level  and  the  potential  indicators  of 
quality,  while  at  the  same  time  removing  the  effect 
of  the  amount  of  time  the  p>erson  worked  as  a 
contract  specialist. 
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Since  some  of  the  attributes  we  were  interested  in 
exploring  in  these  analyses  came  from  information 
supplied  by  employees  and  other  information  was 
provided  by  supervisors,  it  was  necessary  to  link 
the  survey  responses  from  a  particular  employee 
to  the  information  that  was  obtained  from  his  or 
her  supervisor.  For  this  reason,  we  were  not  able 
to  use  the  information  that  was  collected  from 
every  employee  or  supervisor  responding  to  our 
survey.  Imtead,  information  in  tl^  portion  of  the 
report  is  based  only  on  data  obtained  for  those 
cases  where  completed  surveys  were  returned 
from  both  an  employee  and  his  or  her  supervise*. 
Altogether,  records  with  matched  resporrses  for 
both  employees  and  supervisors  were  returned  in 
4,155  cases.  This  was  a  more  than  adequate 
number  of  linked  sets  of  responses  to  permit 
arralyses  addressing  the  relationship  between 
potential  indicators  of  quality  and  actual  assess¬ 
ments  of  work  performance. 

Although  it  would  certainly  have  been  valuable  if 
we  had  been  able  to  do  so,  it  was  technically  not 
feasible  to  relate  measurements  of  individual 
performance  to  the  assessments  of  overall 
workforce  quality  that  were  obtained  from  either 
the  SES  members  or  the  private  sector  vendors. 

For  this  reason,  we  determined  the  validity  of  the 
potential  indicators  of  workforce  quality  solely  on 
the  basis  of  assessments  of  performance  obtained 
from  employees  and  their  supervisors. 

Relationships  Between  Work 
Performance  Assessments  and 
Potential  Indicators  of  Quality 

We  used  statistical  analyses  to  determine  the 
extent  of  the  relationship  between  each  of  the 
assessments  of  work  performance  and  each  of  the 
potential  quality  indicators.  While  results  of  these 
analyses  for  each  of  the  potential  indicators  of 


quality  and  each  type  of  performance  assessment 
are  shown  in  the  appendix  to  this  report,  in 
general,  none  of  the  potential  quality  indicators 
were  highly  correlated  to  actual  assessments  of 
performance.  At  best,  these  indicators  showed  a 
small  but  statistically  significant  relationship  to 
performance. 

Although  the  size  of  the  relationship  was  not 
particularly  larg  \  the  level  of  formal  education 
completed  was  one  of  the  better  available  predic¬ 
tors  of  performance.  There  was  a  relatively  strong 
relationship  between  education  and  advancement 
rate  and  a  modest  but  significant  relationship 
between  education  and  the  ratings  of  performance 
obtained  from  both  employees  themselves  and 
their  supervisors.  With  regard  to  most  of  the 
assessments  of  performance,  people  who  have  a 
bachelor's  degree  do  better  th^  those  without  one 
and  those  with  an  advanced  degree  perform  even 
better.  Given  the  existence  of  a  significant  rela¬ 
tionship  between  education  level  and  most  of  the 
measures  of  performance,  it  is  interesting  that 
education  level  was  not  found  to  be  related  to  the 
formal  annual  p>erformance  appraisal  rating.  For 
some  reason,  even  though  supervisors  rated 
employees  with  more  education  higher  in  a 
variety  of  ways,  they  did  not  give  them  higher 
formal  performance  appraisal  ratings. 

The  niunber  of  Government  training  courses 
completed  and  the  number  of  awards  received 
also  showed  a  consistent  pattern  of  relationship  to 
the  various  performance  ratings.  In  fact,  both 
would  seem  to  have  some  potential  as  indicators 
of  changes  in  the  quality  of  the  procurement 
workforce  over  time.  ITus  potential  is  limited, 
however,  by  the  extent  to  which  the  availability  of 
training  and  awards  is  driven  by  budgetary 
considerations.  If  decisions  on  awards  and  train¬ 
ing  were  made  independently  of  budget  limita¬ 
tions,  then  increases  in  either  would  be  likely  to 
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indicate  improvements  in  workforce  quality.  It  is 
also  worth  noting  that  the  existence  of  a  significant 
relationship  between  completion  of  training  and 
performance  also  provides  evidence  that  training 
can  be  effective  in  improving  performance. 

Performance  in  school  was  also  related  to  assess¬ 
ments  of  work  performance,  although  to  some¬ 
what  less  an  extent  than  level  of  education 
completed.  Interestingly,  class  standing  appeared 
to  be  a  slightly  better  predictor  of  performance 
than  did  the  person's  GPA,  which  showed  a  low 
but  significant  relationship  to  four  of  the  nine 
measures  of  performance  collected  in  this  study. 
Somewhat  surprisingly,  a  self  report  of  general 
grades  in  high  school  showed  a  greater  relation¬ 
ship  to  performance  than  did  a  self  report  of  GPA 
in  college.  We  also  foimd  that  the  patterns  of 
relationship  between  an  employee's  GPA  diuing 
the  last  2  years  of  college,  as  well  as  in  his  or  her 
major  field,  were  virtually  identical  to  the  pattern 
obtained  for  the  overall  GPA. 

It  is  also  interesting  that  the  ntunber  of  college 
courses  completed  in  related  fields  showed  the 
greatest  relationship  to  employee's  self  assess¬ 
ments.  This  might  indicate  that  although 
completion  of  courses  in  related  fields  does  not 
actually  improve  p)erformcmce,  at  least  according 
to  ratings  provid^  by  supervisors,  it  may  increase 
the  person's  confidence  in  his  or  her  ability  to  do 
the  work  of  a  contract  specialist. 


The  relationship  between  work  experience  in  other 
occupational  fields  and  performaiKe  was  also 
somewhat  surprising.  To  some  extent,  the  more 
years  of  experience  a  person  had  working  outside 
of  Government  the  lower  the  ratings  given  for  his 
or  her  work  performance.  This  was  true  for  both 
self  and  supervisory  ratings.  The  reasons  for  this 
result  are  unknown,  although  it  may  be  a  finding 
that  is  peculiar  to  the  unique  character  of  Federal 
procurement  work. 

There  was  also  a  significant  negative  correlation 
between  years  of  experience  in  clerical  work  and 
performance  as  a  contract  specialist.  As  a  group, 
employees  with  more  clerical  experience  tended  to 
get  lower  ratings  than  those  with  other  back¬ 
grounds.  It  was  particularly  interesting  that 
employees  drawn  from  these  backgroimds  not 
only  received  lower  ratings  from  their  supervisors, 
but  also  on  average  gave  themselves  lower  rat¬ 
ings.  We  also  found  that  the  average  yearly  time 
devoted  to  self  improvement  was  not  generally 
related  to  assessments  of  work  performance. 
Similarly,  years  of  work  experience  in  accounting 
or  other  technical  areas  was  unrelated  to  perfor¬ 
mance  in  the  current  job. 

Based  on  the  results  of  this  part  of  the  study,  it 
appears  that  even  though  the  extent  of  the  rela¬ 
tionships  was  small,  there  are  a  few  general 
indicators  of  quality  which  might  be  used  to  track 
gross  changes  in  the  quality  of  the  Federal  pro¬ 
curement  workforce.  These  include:  the  education 
level  of  the  workforce,  the  number  of  awards 
received,  the  number  of  training  courses 
completed  and,  to  a  lesser  extent,  class  standing. 


A  Report  by  the  U.S.  Merit  Systems  Protection  Board 


45 


Quality  in  Federal 


Procurement 


The  Qualify  of  Work  in  Federal 
Procurement 

This  study  began  with  several  purposes.  The  first 
was  to  evaluate  the  quality  of  the  procurement 
workforce  and  the  work  that  they  perform.  To 
some  extent,  we  expected  that  the  quality  of  the 
current  members  of  the  Federal  procurement 
workforce  would  be  a  major  component  affecting 
the  quality  of  procurement  actions.  Thus,  one  of 
the  ^t  things  we  looked  at  was  the  quality  of  the 
contract  specialist  workforce.  To  do  this  we  began 
with  a  tentative  definition  which  suggested  that 
workforce  quality  might  be  measured  by  the 
extent  to  which  the  skills,  knowledges,  and  abili¬ 
ties  possessed  by  members  of  the  workforce 
match  the  requirements  of  the  job.  In  the  course  of 
conducting  this  study,  however,  we  found  that  the 
quality  of  the  workforce  cannot  be  evaluated  apart 
from  the  environment  in  which  it  operates.  A 
meaningful  assessment  of  the  quality  of  procure¬ 
ment  in  the  Federal  Government  must  include 
both  an  evaluation  of  the  capabilities  of  the 
workforce  and  an  appraisal  of  other  factors  that 
affect  performance. 

Using  the  definition  of  workforce  quality  as  the 
match  between  employee  skills  and  job  require¬ 
ments,  we  found  the  Federal  procurement 
workforce  to  be  basically  qualified.  Contract 
specialists  generaUy  believed  that  they  p)0ssess  the 
skills,  knowledges,  and  abilities  that  they  need. 


and  to  some  extent  their  view  is  substantiated  by 
the  large  percentage  of  employees  who  received 
high  performance  appraisal  ratings  and  awards. 
However,  most  employees  said  that  additional 
training  is  required,  both  to  perform  critical  tasks 
better  and  to  stay  abreast  of  changes  in  regula¬ 
tions. 

Supervisors  were  also  positive  about  the  capabili¬ 
ties  of  their  subordinates,  but  overall  presented  a 
picture  of  a  somewhat  less  able  workforce  than 
did  the  employees  themselves.  Although  supervi¬ 
sors  believed  that  their  subordinates  possess  at 
least  acceptable  levels  of  required  skiUs  and 
abilities,  they  also  thought  that  there  is 
considerable  room  for  improvement.  In  many 
cases,  supervisors  saw  additioiral  training  as  a 
way  to  improve.  This  was  especially  true  with 
reg^  to  ^e  ability  of  their  subordinates  to 
conduct  negotiations,  to  write,  to  be  analytical  and 
to  be  innovative. 

When  we  looked  more  closely  at  the  mformation 
provided  by  employees  and  supervisors  as  well  as 
the  client  groups  of  senior  executive  and 
contractors,  it  was  clear  that  the  quality  of  the 
work  performed  by  contract  specialists  involved 
more  than  a  simple  assessment  of  their  ability  to 
cany  out  the  tasks  needed  to  purchase  goods  and 
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services  for  the  Government  Although  both 
employees  and  supervisors  believed  that  most 
contract  specialists  know  how  to  perform  the  tasks 
required  to  conduct  most  procurement  actions, 
clients  of  contract  specialists  were  not  entirely 
satisfied  with  the  (piality  of  the  service  they  are 
given. 

SES  members  were  quite  positive  about  some 
work  outcomes.  In  their  eyes,  contracts  are 
awarded  fairly  and  appropriately;  regulations  are 
applied  accurately;  and  contract  specialists  are 
loiowledgeable  about  procurement  regulations. 
However,  many  senior  executives  were  concerned 
about  the  timeliness  of  some  procurement  actions. 
More  importantly,  many  did  not  believe  that  the 
procurement  process  is  particularly  responsive  to 
the  needs  of  their  organization.  From  the  perspec¬ 
tive  of  our  SES  respondents,  the  procurement 
process  has  become  too  complicated — so 
complicated,  in  fact,  that  they  believed  the 
system's  complexities  may  exceed  the  capabilities 
of  the  contract  specialists  who  must  administer  the 
system.  According  to  the  SES  members,  this  can 
result  in  heavy  work  loads  and  difficulties  in 
meeting  organizational  deadlines.  Unfortunately, 
these  results  can  lead  to  additional  pressure  being 
placed  on  contract  specialists  to  cut  comers  or 
break  rules  in  order  to  improve  timeliness  or 
obligate  more  money. 

To  a  great  extent,  both  employees  and  their 
supervisors  shared  this  view  of  the  procurement 
process.  Moreover,  supervisors  and  senior  execu¬ 
tives  indicated  in  their  comments  that  too  often,  in 
order  to  deal  with  these  pressures  and  protect 
themselves,  contract  spedalists  become  so  rule 
bound  that  they  lose  their  perspective  about  their 
role  in  the  organization.  The  cumulative  effect  led 
many  SES  members  to  conclude  that  the  procure¬ 
ment  process  frequently  results  in  procurement 
decisions  that  are  neither  cost-effective  nor  in  the 
best  interests  of  the  Government. 


Private  sector  vendors  were  also  concerned  with 
the  procurement  process  and  the  work  performed 
by  Federal  contract  specialists.  They  sh^ed  the 
view  of  SES  members,  contract  spedalists,  and 
supervisors  that  the  procurement  process  has 
become  too  complicated.  Like  many  Federal 
contract  specialists,  they  reported  considerable 
difficulty  keeping  abreast  of  all  the  changes 
occurring  in  Federal  procurement  regulations. 

Several  additional  concerns  which  relate  more 
directly  to  the  work  performed  by  contract  special¬ 
ists  were  also  expres^  by  private  contractors. 
Specifically,  they  indicated  that  they  sometimes 
had  problems  tmderstanding  exactly  what  the 
Government  wishes  to  buy.  To  some  extent,  this 
may  have  been  the  result  of  the  multitude  of 
regulatory  requirements  that  must  be  met  in 
connection  with  most  procurement  actions,  but 
contractors  also  believed  this  problem  arose 
because,  in  their  view,  contract  spedalists  some¬ 
times  lack  an  adequate  understanding  of  substan¬ 
tive  issues  involved  in  the  contrad.  Similarly,  SES 
members  said  that  contract  spedalists  sometimes 
do  not  fully  imderstand  the  nature  of  the  goods 
and  services  that  they  are  supposed  to  purchase 
for  their  organization. 

Private  contractors  also  reported  a  relatively  high 
number  of  disputes  with  contrad  spedalists 
concerning  their  performance  under  the  terms  of 
the  contrad.  A  sizable  minority  of  these 
contradors  believed  these  disputes  were  settled  in 
an  arbitrary  maimer.  More  critically,  contradors 
sometimes  said  that  contrad  specialists  are  not 
sensitive  to  their  needs,  do  not  respond  to  them  in 
a  timely  maimer,  and  in  some  cases  show  them 
little  respect  For  all  of  these  reasons,  private 
vendors  asserted  that  the  cumulative  effect  of 
these  problems  is  such  that  the  procurement 
process  frequently  serves  the  best  interests  of 
neither  the  Government  nor  private  businesses. 
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Given  the  concerns  of  supervisors,  SES  members, 
and  private  contractors,  it  is  apparent  that  there 
are  significant  problems  and  di^tisfactions  with 
the  work  performed  by  contract  specialists.  The 
primary  factor  behind  these  problems  appears  to 
be  the  inability  of  contract  specialists  to  deal  with 
the  increasin^y  complicated  requirements  under 
which  they  must  work.  Over  the  past  10  to  15 
years,  there  has  been  a  tremendous  increase  in  the 
number  and  complexity  of  the  regulations  which 
govern  F^eral  procurements.  As  the  number  of 
regulations  has  increased,  so  has  the  complexity  of 
job  requirements  and  the  amount  of  time  it  tak^ 
for  a  contract  specialist  to  complete  many  pur¬ 
chases.  Under  these  conditions  it  is  not  enough  to 
possess  merely  adequate  skills.  Rather,  to  do  a 
good  job  in  today's  work  environment,  it  appears 
that  most  contract  specialists  need  a  high  degree 
of  both  analytical  ability  and  creativity.  Unfortu¬ 
nately,  these  are  exactly  the  skills  both  supervisors 
and  members  of  the  SK  believed  are  most  often 
lacking  in  contract  specialists. 

While  exceptional  contract  specialists  are  able  to 
use  their  creativity  to  develop  innovative  and  legal 
solutions  to  meet  organizational  requirements, 
less  capable  employees  are  frequently  faced  with  a 
dilemma.  Either  they  bow  to  management  pres¬ 
sure  to  do  things  faster,  even  if  this  involves 
bending  the  rules,  or  they  develop  a  rule-bound 
approa  A  that  can  compromise  their  responsive¬ 
ness  to  organizational  needs.  Given  the  potential 
personal  costs  associated  with  failure  to  adhere  to 
procurement  regulations,  it  is  not  surprising  that 
many  contract  specialists  choose  to  follow  the 
latter  course.  It  is  also  not  surprising  that  mem¬ 
bers  of  their  organization  are  sometimes  not 
satisfied  by  the  resulting  support. 


Validation  of  Potential 
Quality  Indicators 

A  second  purpose  of  this  study  was  to  determine 
whether  there  is,  in  fact,  a  statistically  significant 
idationship  between  the  potential  quality  indica¬ 
tors  and  actual  performance.  Although  the  sizes 
of  the  relationsMps  are  small,  there  are  a  few 
general  indicators  of  quality  which  might  be  of 
some  limited  use  in  tracking  gross  changes  in  the 
quality  of  the  Federal  procurement  workforce. 

The  single  best  indicator  is  the  education  level  of 
the  workforce.  In  general,  the  more  education 
completed  by  a  worker  the  higher  the  quality  of 
his  or  her  work.  This  is  not  to  say,  however,  that  a 
person  must  possess  a  college  degree  in  order  to 
be  a  high-quality  contract  specialist.  The  relation¬ 
ship  between  education  and  performaiure  is  not 
large  enough  to  indicate  that  possession  of  a 
college  degree  should  be  a  nunimum  qualification 
for  admission  to  the  field. 

To  a  lesser  degree,  assessments  of  performance  in 
both  high  school  aivd  college  were  found  to  be 
valid  predictors  of  quality.  Of  the  various  mea¬ 
sures  of  scholastic  performance,  class  standing 
appears  to  be  a  slightly  better  indicator  of  quality 
tl^  does  either  GPA  or  the  number  of  college 
courses  completed  in  procurement-related  fields, 
both  of  which  showed  a  small  degree  of  relation¬ 
ship  to  at  least  a  few  of  the  assessments  of  work 
performance. 

Two  other  factors  look  like  they  might  be  fairly 
good  iiKlicators  of  quality  imder  certain 
coiKiitions.  To  the  extent  that  the  number  of 
awards  is  not  dictated  by  budgetary 
considerations  or  changes  in  management  phi¬ 
losophy,  the  percentage  of  employees  receiving 
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awards  could  probably  serve  as  a  fairly  good 
indicator  of  changes  in  workforce  quality.  In¬ 
creases  in  the  number  of  awards  given  would,  of 
course,  imply  improvements  in  the  quality  of  the 
workforce.  Similarly,  changes  in  the  average 
number  of  training  courses  completed  by  each 
employee  would  reflect  changes  in  the  quality  of 
the  workforce. 


Establishment  of  a  Baseline  for 
Future  Research 

A  final  goal  of  this  study  was  to  provide  informa¬ 
tion  that  can  serve  as  a  betseline  for  use  in  future 
research.  Considerable  information  has  been 
obtained  through  this  study  that  can  be  used  for 
this  purpose.  In  addition  to  determining  which  of 
the  measures  we  tested  are  Vctlid  predictors  of 
quality,  this  study  collected  a  great  deal  of  infor¬ 
mation  which  can  serve  as  a  basis  for  determining 
changes  in  the  qxiality  of  the  contract  specialist 
workforce  over  time. 


Summaries  of  the  various  ratings  of  work  perfor¬ 
mance  collected  through  this  study  were  pre¬ 
sented  elsewhere  in  this  report.  We  hope  that  this 
mformation  will  be  used  by  future  researchers  to 
track  changes  in  the  capabilities  of  the  Federal 
procurement  workforce  over  time.  Although  the 
ratings  of  abilities  aivi  performance  provided  by 
both  employees  and  supervisors  were  high,  if 
improvements  are  made  in  the  quality  of  the 
procurement  workforce,  then  even  higher  ratings 
should  be  expected.  Using  a  few  of  these  ratings 
should  make  it  easier  to  track  the  progress  of 
efforts  such  as  those  of  the  Office  of  Federal 
Procurement  Policy  to  professionalize  the  procure¬ 
ment  workforce. 
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Recommendation  1:  Provide 
Additional  Itaining  to  Improve  the 
Quality  of  the  Cuirent  Workforce 

According  to  the  results  obtained  in  this  study, 
contract  specialists  need  to  be  better  prepared  to 
make  the  best  possible  business  decisions  for  their 
organizations  in  a  timely  manner.  Based  upon  the 
assessments  provided  by  procurement  supervi¬ 
sors  in  response  to  our  survey,  training  should  be 
directed  towards  improving  the  capability  of  the 
workforce  to  conduct  negotiations,  analyze  re¬ 
quirements,  write  clearly,  and  develop  innovative 
solutions  to  meet  organizational  needs. 

Training  is  particularly  important  since  almost 
half  of  the  current  procurement  workforce  has 
fewer  than  7  years  of  experieiKe  in  the  occupa¬ 
tional  series.  Incumbents  with  the  least  experience 
are  the  ones  most  likely  to  need  training.  More¬ 
over,  approximately  three-quarters  of  the  people 
employ^  in  the  G^l  102  series  currently  work  for 
one  of  the  Defoise  agencies.  Since  it  is  dear  that 
the  immediate  future  will  bring  reductions  in  the 
size  of  the  Defense  budget,  it  is  unlikely  that  the 
total  Federal  procurement  workforce  will  continue 
to  grow  as  it  has  since  1981.  For  this  reason,  any 
marked  improvements  in  the  quality  of  the 
procurement  workforce  are  not  likely  to  come 
from  lai^e  infusions  of  highly  qualified  t>ew 
workers.  Significant  improvements  in  workforce 
quality  can  only  result  through  an  improvement 
in  the  capabilities  of  current  GS-1 102  incumbents. 


Although  at  the  present  time  both  employees  and 
supervisors  are  looking  to  training  to  help  them 
cope  with  the  difficult  work  situations  they  often 
iace,  traming  in  and  of  itself  may  not  be  the 
answer.  Unless  it  is  done  well,  training  may  only 
teach  people  the  rules  and  how  to  apply  them  in  a 
predetermined  fashion.  It  will  not  necessarily 
provide  them  with  the  breath  of  understanding  of 
procurement  which  is  required  to  work  in  toda/s 
world.  For  this  reason,  it  is  our  view  that  procure¬ 
ment  training  needs  to  address  a  key  issue:  how 
to  make  informed  business  decisions  that  permit 
an  or^nization  to  purchase  goods  aixl  services 
need^  to  meet  mission  objectives  in  a  cost- 
effective  maimer. 

In  order  to  make  informed  business  decisions, 
people  need  to  be  trained  in  the  philosophy  of 
procurement.  This  includes  a  better  understand¬ 
ing  of  the  mission  of  their  organization  and  the 
role  they  play  in  purchasing  the  goods  and  ser¬ 
vices  n^ed  to  meet  organizational  requirements. 
They  also  need  to  know  the  range  of  options  that 
are  available  to  them  aiKl  to  understand  the  basis 
for  choosing  among  available  options.  At  some 
level  this  probably  also  involves  an  understanding 
of  the  private  sector  businesses  with  which  they 
will  be  dealing.  From  the  perspective  of  the 
jTrivate  contradors,  it  would  probably  also  be 
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useful  for  the  contract  specialist  to  imderstand 
how  their  business  operates  aiKi  the  fectors  that 
aAect  their  ability  to  deliver  the  goods  or  services 
they  will  be  producing. 

Recommendation  2:  Encourage  and 
Reward  Creativity 


Emphasis  should  also  be  placed  on  ensuring  that 
contract  specialists  understand  that  they  are  an 
integral  part  of  a  team  whose  purpose  is  to  meet 
organizational  objectives  and  serve  the  public 
gc^.  Accordingly,  supervisors  should  strive  to 
create  an  atmosphere  in  which  making  good 
business  decisions  is  at  least  as  likely  to  be  re¬ 
warded  as  avoiding  protests. 


This  study  found  that  both  employees  and  their 
supervisors  believed  that  most  of  the  people 
working  as  Federal  contract  specialists  have  the 
skills,  knowledges,  and  abilities  needed  to  per¬ 
form  well.  In  the  final  analysis,  however,  the 
custonners  for  the  services  provided  by  contract 
specialists  were  not  always  satished.  To  some 
extent,  inappropriate  or  Inadequate  supervision 
may  have  contributed  to  this  result. 

Although  supervisors  of  contract  specialists 
critidze  their  subordinates  for  a  lack  of  aeativity, 
it  is  the  supervisors  who  must  bear  at  least  some 
of  the  responsibility  for  this  state  of  affairs.  It  is 
the  supervisors  who  set  the  tone  for  the  organiza¬ 
tion.  In  many  cases  they  choose  to  reward  "rule- 
bound"  approaches  to  contracting  and  discourage 
their  subordinates  from  being  more  creative  and 
using  the  flexibilities  that  are  currently  available  to 
them.  If  contract  specialists  are  to  be  more 
creative,  supervisors  need  to  foster  an  environ¬ 
ment  in  which  employees  are  not  afiaid  to  be 
innovative.  Employees  need  to  know  that  risk 
taking  can  be  benefldal  to  the  organization  as  long 
as  it  does  not  result  in  illegal  actions.  Through 
their  leadership,  supervisors  need  to  show  em¬ 
ployees  how  they  can  be  more  responsive  to  their 
customers  without  breaking  the  rules. 


Recommendation  3:  Ensure  that  High- 
Quality  Selections  Are  Made  for  Entry- 
Level  Positions 

According  to  many  supervisors,  there  has  been  a 
decline  in  the  quality  of  new  entrants  to  the  CS- 
1102  series  over  the  last  10  to  15  years.  While 
there  is  only  minimal  evidence  to  support  this 
contention,  it  is  clear  that  the  skills,  Imowledges, 
and  abilities  needed  by  contract  specialists  have 
increased  in  number  or  complexity.  For  this 
reason,  efforts  designed  to  improve  the  quality  of 
selections  for  GS-1 102  vacancies  are  important. 
Over  time,  an  improvement  in  the  quaUty  of  the 
people  becoming  contract  specialists  can  have  a 
major  impact  on  the  quality  of  Federal  procure¬ 
ments. 

In  at  least  the  recent  past,  supervisors  of  contract 
specialists  have  not  ^ways  looked  to  all  possible 
recruitment  sources.  Very  little  use  in  filling 
vacancies  has  been  made  of  the  persons  available 
through  the  Presidential  Management  Intern 
Program  or  OPM's  recently  developed  Adminis¬ 
trative  Careers  with  America  (ACWA)  proce¬ 
dures.  In  fact,  even  though  a  written  test  devel¬ 
oped  for  use  in  conjunction  with  the  ACWA 
procedures  has  been  shown  to  be  a  useful  instru¬ 
ment  for  selecting  high-quality  applicants,^  only 
77  new  contract  specialists  were  selected  from  this 
source  during  fis^  year  1991 In  our  view,  an 
improvement  in  the  quality  of  new  entrants  to  the 


°  For  information  concerning  OPM's  Adminisiralive  Careers  with  America  procedures  see;  US.  Merit  Systems  Protection  Board, 
"Attracting  and  Selecting  Quality  Applicants  for  Federal  Employment,'  April  1990. 

°  Information  concerning  the  nuniber  of  persons  selected  through  ^  use  of  the  ACWA  procedures  during  fiscal  year  1991  provided  by 
dw  U.S.  Office  of  Persoimel  Management. 
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GS-1102  series  can  be  made  through  greater  use  of 
the  applicants  who  are  referred  for  consideration 
through  either  use  of  the  ACWA  procedures  or 
the  Presidential  Management  Intern  Program. 

Since  the  vast  majority  of  new  contract  specialists 
have  entered  the  GS-l  102  series  through  the  use  of 
inservke  placements  and  there  is  some  evideiKe 
suggesting  that,  on  average,  the  quality  of  persons 
selected  in  this  manner  may  be  margiiially  lower 
than  that  for  people  selected  in  other  ways,  it  is 
also  important  that  efforts  be  made  to  ensure  that 
new  inservice  placements  are  of  the  highest 
possible  quality.  Based  on  the  small  but  statisti¬ 
cally  significant  differeiKes  we  found  in  assess¬ 
ments  of  performatKe  as  related  to  source  of  entry, 
it  is  apparent  that  supervisors  making  inservke 
placement  selections  have  not  always  done  a  good 
job  of  selecting  from  among  the  best  people 
available  from  within  the  Federal  Government.  In 
fact,  to  the  extent  that  poor  selections  have  been 
made  through  the  use  of  inservice  placements, 
supervisors  must  bear  much  of  the  responsibility. 
In  our  view,  when  inservice  placement  procedures 
are  used  to  select  people  for  contract  specialist 
vacancies,  managers  need  to  look  beyond  the 
employees  working  for  their  immediate  organiza¬ 
tion.  Consideration  should  be  given  to  employees 
with  high  potential  regardless  of  where  they  work 
in  the  orgaruzation  or  even  the  agency.  Procure¬ 
ment  managers  should  also  look  to  their  person¬ 
nel  offices  for  assistance  in  developing  valid 
selection  procedures  for  identifying  the  best 
candidates  for  entrance  into  the  GS-l  102  series. 

In  order  to  assist  supervisors  in  the  selection  of 
new  entrants  into  the  GS-l  102  series,  OFPP  has 
proposed  the  development  of  an  inservice  place¬ 
ment  exam  to  screen  applicants  who  already  work 
for  the  Government  in  other  positioirs  and  who 
wish  to  be  considered  for  en^-level  positions  in 
the  GS-l  102  series.  To  the  extent  that  OPM, 
working  with  OFPP,  can  develop  an  exam  whkh 
provides  a  valid  assessment  of  a  person's  ability  to 
become  a  high-quality  contract  specialist,  MSPB 
concurs  with  this  effort. 


Although  the  Board  believes  that  additional  efforts 
are  required  to  ensure  that  high-quality  inservke 
selections  are  made,  we  do  not  believe  that  inter¬ 
nal  placements  should  be  elinunated.  This  source 
of  entry  provides  an  important  avenue  of  ad- 
vaiKement  to  employees  with  ability  who  might 
otherwise  be  stuck  in  positions  in  which  they 
could  not  reach  their  highest  potential.  Adchtion- 
ally,  under  economk  conditions  where  the  Gov- 
otunent  has  difficulty  attracting  adequate  num¬ 
bers  of  high-(]uality  applicants  fi’om  external 
sources,  employees  akeady  working  for  the 
Government  in  other  areas  have  always  been  a 
critically  important  source  for  meeting  staffing 
requirements. 

Similarly,  even  though  we  found  that  there  was  a 
significant  relationship  between  the  education  of 
an  employee  and  his  or  her  performance,  the 
relationship  was  not  of  sufficient  magnitude  to 
limit  selection  to  only  those  applicants  who  have 
completed  college.  Since  many  persons  who  do 
not  luve  a  degree  are  excellent  contract  specialists, 
applicants  should  not  be  eliminated  from 
competition  just  because  they  do  not  possess  a 
college  degree  or  a  degree  in  a  business-related 
field.  Instead,  whenever  possible,  agencies  and 
managers  should  use  rigorous  competition  and 
valid  selection  instruments  to  ensure  that  they 
select  the  best  possible  applicants  regardless  of  the 
source  of  entry. 

Recommendation  4:  Where  Possible, 
Streamline  and  Simplify  the 
Procurement  Process 

Over  the  years  the  procurement  process  has 
become  increasingly  complex,  primarily  to  pro¬ 
vide  a  measure  of  control  over  the  actions  of  the 
contract  specialists  in  an  attempt  to  curb  both 
intention^  and  unintentional  abuses  of  the  pro- 
curennent  process.  Thus,  the  complexity  of  the 
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procurement  system  may  reflect  an  assessment  of 
Government  officials  concerning  the  limitations  of 
the  procurement  workforce.  By  providing  so 
much  structure  through  increases  in  rules  and 
regulations,  procurement  policymakers  may  be 
saying  that  contract  specialists  are  likely  to  get  into 
trouble  if  they  are  given  too  much  flexibility. 
Unfortunately,  this  has  led  to  imforeseen 
consequences.  As  the  number  and  complexity  of 
the  regulations  has  increased,  the  ability  of 
contract  specialists  to  be  responsive  to  the  best 
interests  of  their  organizations  and  the  Govenv- 
ment  as  a  whole  has  decreased. 

From  the  perspective  of  MSPB,  any  attempt  to 
improve  the  quality  of  Federal  procurement 
should  include  a  careful  review  of  the  procure¬ 
ment  process  itself.  In  the  current  state  of  affairs, 
it  is  frequently  only  the  exceptionally  talented 
contract  specialist  who  is  able  to  be  fully  respon¬ 
sive  to  his  or  her  organization  and  still  adhere  to 
regulatory  requirements.  For  this  reason,  it  is  our 
view  that  a  decision  is  needed  concerning  the 


appropriate  balance  between  guarding  against 
abuses  and  providing  contract  specialists  with  the 
flexibilities  that  may  allow  them  to  complete  work 
in  a  more  timely  and  cost  effective  manner.  This 
evaluation  should  include  an  assessment  of  the 
net  effect  of  recent  regulatory  changes.  The  goal  in 
looking  at  issues  like  these  should  be  to  identify 
those  areas  that  can  be  simplified  without  an 
inordinate  reduction  in  protection  against  abuse. 

Where  it  is  feasible  to  do  so,  contract  specialists 
need  to  be  given  greater  flexibility  to  make  good 
management  decisions  which  are  in  the  best 
interests  of  the  Government.  Simplification  of  the 
procedures  can  reduce  the  burden  placed  on 
contract  specialists,  improve  the  timeliness  of 
actions,  and  allow  organizations  more  options  to 
make  good  decisions  in  purchasing  the  things  that 
they  need.  Of  course  the  capability  to  do  this  rests 
on  the  assiunption  that  contract  specialists  under- 
^nd  how  to  use  any  additional  options  that  may 
be  provided  to  them.  Accordingly,  the  quality  of 
the  workforce  should  be  as  high  as  realistically 
possible. 
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The  table  below  presents  the  correlation  coefficients  showing  the  amount  of  relationship  between  each 
assessment  of  employee  performance  and  each  of  the  potential  indicators  of  quality.  In  general,  a 
correlation  coefficient  indexes  the  amount  of  relationship  between  two  variables.  The  greater  the 
absolute  value  of  the  coefficient  (i.e.,  the  larger  the  number  disregarding  whether  the  sign  is  positive  or 
negative)  the  greater  the  similarity  in  what  the  two  scores  are  measuring.  The  highest  possible  score  is 
1 .00,  meaning  that  the  two  variables  are  in  effect  measuring  the  same  thing.  The  lowest  score  is  0.00 
which  means  that  the  two  measures  have  nothing  in  common. 

As  can  be  seen  in  this  table,  many  of  the  correlation  coefficients  tend  to  be  close  to  0.00.  This  means  that, 
in  these  ittstaiKes,  the  relationship  between  the  various  assessments  of  performance  and  the  potential 
quality  indicators  is  rather  small.  The  best  of  these  potential  indicators  (i.e.,  those  indicators  having  the 
largest  correlation  with  assessments  of  performance)  were  the  employee's  education  level,  number  of 
training  courses  completed,  and  number  of  awards  received. 
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TABLE  17 

RELATIONSHIP  BETWEEN  PERFORMANCE  ASSESSMENTS  AND 
QUALITY  INDICATORS  FOR  GS-1102  EMPLOYEES  (Correlation  CoefTicients) 

Performance  Assessment  £|i 

Class 

Overall 

g 

High  No.  of  Years  No.  of  Awards  Years  Years 

School  Related  Outside  Training  Last  24  Business  Clerical 
Grades  Courses  Government  Courses  Months  Experience  Rxnerienre 

Average  Self  Rating 
(9  Abilities) 

.14 

.11 

.01* 

.10 

.11 

.01* 

.18 

.13 

.05 

-.06 

Average  Self  Rating 
(20  Tasks) 

.13 

.10 

.10 

.13 

.06 

-.11 

.14 

.20 

.02* 

-.10 

Aver^  Supervisory  Rating 
(9  Abilities) 

.14 

.10 

.01* 

.11 

.15 

-.04 

.31 

.15 

.12 

-.07 

Average  Supervisory  Rating 
(20  Tasks) 

.13 

.08 

.05 

.12 

.08 

-.11 

.21 

.19 

.08 

-.09 

Annual  Perfnwance 

Appraisal  Rating 

.03* 

.06 

.07 

.11 

-.00* 

-.07 

.08 

.31 

.02* 

.00* 

Advancement  Rate  (Grade  Attained 
Controlling  for  length  of  Service) 

.39 

.21 

.01* 

.10 

.02* 

-.08 

.36 

.18 

-.02* 

-.25 

Average  Rescardi  Rating 

.06 

.07 

.10 

.13 

.01* 

-.12 

.11 

.21 

.00* 

-.05 

Supervisory  Assessment  Training 
Required  (Crititcal  Tasks) 

.10 

.04 

-.01* 

.04 

.03 

.02* 

.10 

.04 

..08 

-.06 

Supervisory  Assessment  Training 
Required  (9  Abilities) 

-.11 

-.04 

-.01* 

-.06 

-.07 

.06 

-.21 

-.09 

-.12 

.08 

Note:  Except  where  indicated  by  all  of  the  correlation  coefficients  represent  statistically  significant  relationships 

at  the  p^.05  level. 

*  means  that  there  was  not  a  statistically  significant  relationship  between  the  different  measures. 
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THE  VS.  MERIT  SYSTEMS  PROTECTION  BOARD 


Copies  of  these  reports  can  be  obtained  by  writing  to  the  Office  of  Policy  and  Evaluation, 
U.S.  Merit  Systems  Protection  Board,  1120  Vermont  Ave.  NW,  Washington,  DC  20419  or  by 
calling  (202)  653-8900 


■  "Federal  First-Line  Supervisors:  How  Good  Are  They?" 

■  'To  Meet  the  Needs  of  the  Nations:  Staffing  the  U.S.  Civil  Service  and  the  Public 

Service  of  Canada." 

■"Balancing  Work  Responsibilities  and  Family  Needs:  The  Federal  Civil  Service 
Response." 

■"The  Title  38  Personnel  System  in  the  Department  of  Veteran  Affairs:  An  Alternate 
Approach" 

■  "Senior  Executive  Service  Pay  Setting  and  Reassignments:  Expectations  vs.  Reality" 

■  "Working  for  America:  A  Federal  Employee  Survey" 

■  "Why  are  Employees  Leaving  the  Federal  Government?  Result  of  an  Exit  Survey" 

■  "Attracting  and  Selecting  Quality  Applicants  for  Federal  Employment" 
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